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IMAGE PROCESSING APPARATUS HAVING IMAGE SELECTION FUNCTION, 
AND RECORDING MEDIUM HAVING IMAGE SELECTION FUNCTION PROGRAM 
RECORDED THEREIN 



5 INCORPORATION BY REFERENCE 

The disclosures of the following priority applications 
are herein incorporated by reference: 

Japanese Patent Application No. 10-3313$7 November 20, 1998 

Japanese patent Application No. 11-009077 January 18, 1999 

10 Japanese Patent Application No. 11-009078 January 18, 1999 

Japanese Patent Application Mo. 11-009079 January 18, 1999 

Japanese Patent Application No. 11-009080 January IS, 1999 

The disclosures of U.S. Patent No. 5,594,554, Japanese 
15 Patent Application No. 10-284531 and Japanese Patent 
Application No- 10 - 23 6102 . are herein incorporated by 
reference. 

BACKGROUND OP THE INVENTION 
20 1. Field of the Invention 

The present invention relates to an image processing 
apparatus for selecting image data obtained in a good 
photographing state and image data achieving a good image 
quality for storage, and a recording medium having a program 
25 recorded therein . 
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2- Description of the Related Art 

Normally, blurring occurring due to unsteady hands tends 
to occur when taking pictures by holding the camera by hand. 
When such blurring resulting from camera vibration by hand 
5 tremble, the photographic field is moving during exposure, 
which results in a photographed image that is, on the whole, 
blurry. In such a blurry image, fine details become lost over 
the entire image plane, and edges that should toe clearly defined 
become dull. Thus, the resulting image is entirely 

10 unsatisfactory. 

TO provide a solution to problems caused by such camera 
vibration, there are cameras having a camera vibration 
correction mechanism in the known art. PIG. 25 illustrates 
a camera of this type, having a camera vibration correction 

15 mechanism. In FIG. 25, a taking lens 92 is mounted at the front 
surface of a camera 91. Inside the lens barrel of the taking 
lens 92, a camera vibration correction optical system 93 is 
rotatably provided. 

The rotations of two shafts of two coreless motors 94 

20 and 95 are communicated to the camera vibration correction 
optical system 93. to cause it to vibrate in the vertical and 
horizontal directions. In addition, a camera vibration 
quantity detection sensor 96 that detects the quantity of 
camera vibration in the horizontal direction and a camera 

25 vibration quantity detection sensor 97 that detects the 
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quantity of camera vibiration in the vertical direction are 
provided in the camera 91. In the camera 91 structured as 
described above, the vibration of the main body of the camera 
91 is detected by the camera vibration (Quantity detection 
5 sensors 95 and 97. The camera 91 drives the coreless motors 
94 and 95 in the directions opposite from the directions of 
the detected vibration to cause the optical axis of the camera 
vibration correction optical system 93 to vibrate . As a result, 
the vibration of the photographing optical axis is canceled 

10 out so that a good photograph with the camera vibration 
corrected is taken. 

However, there is a problem in the example of the prior 
art described above in that the camera vibration correction 
optical system 93 must be provided in the taking lens 92 which 

15 becomes, therefore, large and heavy. In addition, since only 
camera vibration is corrected in this example of the prior art, 
any degradation in image quality caused by the blurring of a 
moving subject or by poor focus cannot be prevented. 

20 SOMMARY OF THE mVENTION 

An object of the present invention is to provide an image 
processing apparatus that selects image data obtained in a good 
photographing state and achieving a high image quality for 
storage. 

25 In order to achieve the object described above, an image 
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processing apparatus according to the present invention having 
an image selecting function, comprises: an evaluation device 
that takes in a plurality of sets of image data of a subject 
obtained through image - cap turing and perfonns acceptability 
5 evaluation on each of the plurality of sets of image data; and 
an acceptability selection device that selects image data 
ranked high in the acceptability evaluation among the 
plurality of sets of image data having undergone the 
acceptability evaluation performed at the evaluation device. 

10 In this image processing apparatus, preferably, the 

plurality of sets of image data are obtained through continuous 
image- capturing at predetermined time intervals. 

Also, preferably^ the acceptability selection device 
records the selected image data into a recording medium. 

15 In the structure described above, the image - capturing 

device engages in continuous image -cap turing to obtain image 
data corresponding to a plurality of frames in a single 
photographing operation. The evaluation device evaluates 
individual sets of such image data with respect to whether the 

20 photographing state is good or bad or whether the image quality 
is good or bad. The acceptability selection device 
selectively stores good image data that have been ranked high 
in the evaluation by the evaluation device. Through this 
operation, image data generated in a good photographing state 

25 can be selectively acquired according to the present 
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invention. 

An image processing apparatus according to the present 
invention having an image selecting function, comprises: an 
evaluation device that takes in a plurality of sets of image 
5 data obtained through continuous image- capturing and performs 
acceptability evaluation on each of the plurality of sees of 
image data within an evaluation area set to occupy a portion 
of an image plane; and an acceptability selection device that 
selects image data ranked high in the acceptability evaluation 
10 among the plurality of sets of image data having undergone the 
acceptability evaluation performed at the evaluation device 
and records the image data into a recording medium. 

In this image processing apparatus, preferably, the 
evaluation device sets evaluation weighting toward a periphery 
15 of the evaluation area lower than an evaluation weighting at 
a central portion of the evaluation area. 

Also, preferably, a plurality of evaluation areas are 
set at a plurality of locations within the image plane; and 
the evaluation device performs integrated evaluation of 
20 acceptadjility of image data based upon individual evaluations 
performed in the evaluation areas. 

Also, the image processing apparatus preferably further 
comprises an area setting device that selects an evaluation 
area or selects and changes weighting of evaluation areas. 
2 5 In the image processing apparatus provided with this 
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evaluation device, preferably, the area setting device selects 
an evaluation area by excluding light areas and dark areas in 
the image plane or by setting evaluation weigliting for light 
areas and dark areas at a relatively low level. 
5 Also, preferably, the area setting device selects an 

evaluation area by selecting an area that is in a focus- verified 
state in the image plane or by setting evaluation weighting 
for the area that is in a focus -verified state at a relatively 
high level . 

10 Also, preferably, the image processing apparatus 

further comprises an image -capturing device that continuously 
captures images of a subject and the area setting device is 
also utilized to select a photometric area for the image - 
capturing device, and in correspondence to either the 

15 photometric area or the evaluation area that is determined 
first, the other area is determined, in this case, preferably, 
the image processing apparatus further comprises a lock device 
that fixes exposure adjustment in response to an external 
operation, and the area setting device clears or re -sets the 

20 evaluation area when the lock device has fixed the exposure 
adjustment. 

Also, preferably, the image processing apparatus 
further comprises an image -capturing device that continuously 
captures images of a subject and the area setting device is 
25 also utilized to select a focal point detection area for the 
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image -capturing device, and in correspondence to either the 
focal point detection area or the evaluation area that is 
determined first, the other area is determined. In this case, 
preferably, the image processing apparatus further comprises 
5 a lock device that fixes focal adjustment in response to an 
external operation, and the area setting device clears or 
re -sets the evaluation area when the lock device has fixed the 
focal adjustment, 

in the struct-ure described above, the acceptability 

iO evaluation made by the evaluation device is executed in a 
limited evaluation area which is set over a portion of the image 
plane. Thus, there is no risk of the acceptability evaluation 
being affected by blurring in the background image outside the 
area, thereby making it possible to perform the acceptability 

15 evaluation of the image data in an even more accurate manner. 
In addition, since the evaluation area is limited, the length 
of time required for the acceptability evaluation can be 
reduced. 

Generally speaking, when a camera vibration or a 
20 subject -motion occurs, the surrounding image may temporarily 
jump into the periphery of the evaluation area (hereafter, an 
image that jumps into the evaluation area in this manner is 
referred to as a "jump image") . If such jump images are present 
in a plurality of sets of image data, the acceptability 
25 evaluation cannot be performed under the same conditions for 
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all the image data, and thus, the comparative selection of image 
data performed at the acceptability selection device becomes 
slightly inaccurate. However, in the structure described 
above, the evaluation weighting toward the periphery of the 
5 evaluation area is set lower compared to the evaluation 
weighting at the central portion of the evaluation area. 
Consequently, the degree to which such a jump image affects 
the value representing the results of the acceptably 
evaluation is greatly reduced, thereby making it possible to 
10 perform comparative selection of image data at the 

acceptability selection device witH an even higher degree of 
accuracy . 

When there are a plurality of subjects present in the 
photographic image plane, it is desirable to perform an 

15 integrated acceptability evaluation for all these subjects to 
achieve more accurate image evaluation. Accordingly, in the 
structure described above, a plurality of evaluation areas are 
set within the image plane and an integrated evaluation is 
performed using the individual evaluations performed in the 

20 plurality of the evaluation areas for the acceptability 
evaluation of the image data. As a result, accurate 
acceptability evaluation that is appropriate for a situation 
in which there are a plurality of subjects present in the 
photographic image plane is realised. 

25 It is to be noted that examples of the arithmetic 
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operation performed to achieve such an integrated evaluation 
include weighted addition, majority operation, maxinnim value 
operation and minimum value operation. In addition, by simply 
combining these arithmetic operations or combining them 
5 conditionally, more complex and precise integrated evaluation 
can be achieved. The following is an explanation of individual 
functions and advantages of these examples of arithmetic 
operations . 

(Integrated evaluation achieved through weighted 
10 addition of individual evaluations) 

For instance, the evaluation weighting for the 
evaluation area at the center of the image plane may be set 
high while setting the evaluation weighting for the evaluation 
area in the periphery of the image plane to a low value so that 
15 the focus of the evaluation is set on the center of the image 
plane. Thus, through weighted addition, the evaluation 
balance among the individual evaluation areas can be adjusted 
in a flexible and simple mzinner. 

(Integrated evaluation achieved through majority 
2 0 operation performed on individual evaluations) 

In a majority operation, the results of the evaluation 
of the individual evaluation areas are classified into a 
plurality of levels (e.g,, « very good, " "good," "medium" and 
"poor") . Based upon the results of such classification, the 
25 evaluation level applied to the greatest number of evaluation 
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areas is determined to be the evaluation value of the iraage 
data obtained througH the majority operation. Such a majority 
operation minimizes the degree to which minority evaluations 
occurring only in part or occurring accidentally affect the 
5 overall evaluation to make it possible to achieve an accurate, 
integrated evaluation. 

{Integrated evaluation achieved through maximum value 
operation of individual evaluations) 

In a maximum value operation, the evaluation achieving 

10 the highest rank among the evaluations of the individual 

evaluation areas is used as the integrated ©valuation of the 
image data. Under normal circumstances, it is difficult to 
achieve an accurate acceptability evaluation if a large 
portion of the image plane is intentionally left blur and, at 

15 the same time, the subject image is positioned in one of the 
evaluation areas. However, by executing the maximum value 
operation under th«se conditions, the inappropriately low 
evaluation on an undefined background or the like can be 
eliminated with a high degree of reliability in a simple manner. 

20 Furthermore, a relatively high evaluation of the subject image 
located in one of the evaluation areas can be automatically 
extracted. 

(Integrated evaluation achieved through minimum value 
operation of individual evaluations) 
25 In a minimum value operation, the evaluation ranked 
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lowest among the evaluations of cHe individual evaluation 
areas is extracted as the integrated evaluation of tlie image 
data. Thus, the acceptability selection device selects image 
data based upon comparison of the lowest evaluations of the 
5 individual sets of image data. As a result, the acceptability 
selection device selects and stores image data achieving the 
highest rank among the low evaluations. For this reason, the 
minimum value operation described above is ideal in a situation 
in which it is necessary to photograph the entire image plane 

10 in the best possible manner rather than a specific subject, 
e.g., when photographing a group picture or a landscape. 

By adding an area setting device in the structure 
described above, the evaluation area setting can be varied 
freely without restricting the evaluation area selection and 

15 the weighting of the evaluation areas to fixed settings. It 
is to be noted that specific examples of the operating device 
for such setting adjustment include input devices of the known 
art such as a sight line input mechanism, a command dial, a 
mouse and a cross button as well as the semiautomatic adjustment 

20 device described above. 

As a general rule, exposure performed at an image 
processing apparatus (for example an electric camera) under 
certain conditions may result in the brightness level becoming 
collapsed in the light areas and the dark areas within the image 

25 plane. The evaluation device according to the present 
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invention is capable of precisely detecting such a collapse 
in the brightness level as, for instance, a reduction in the 
high spatial frequency component. As a result, it becomes 
possible to select and store image data with a reduced degree 
5 of collapse in the brightness level achieving rich gradation 
over the entire range of brightness as good iznage data. 

However, there are situations in which a collapse in the 
brightness level in a light area or a dark area cannot be avoided, 
as in a photographing operation performed under bright sun in 

10 midLSununer . Under such circumstances, a problem of image data 
being evaluated inappropriately low due to such a collapse in 
the brightness level may arise. As a solution to this problem, 
according to the present invention evaluation areas are set 
by the area setting device by ensuring that the degree of 

15 influence of the light area or dark area within the image plane 
is reduced. As a result, it is possible to prevent an 
inappropriate evaluation from being made due to the brightness 
collapse described above. In addition, in a normal 
photographing environment, it is highly likely that the image 

20 of th« subject to be photographed is located in a roughly 
central brightness area of the image plane. For this reason, 
it is naturally highly likely that the subject image is present 
in an evaluation area set as described above, which makes it 
possible to execute acceptability evaluation of the subject 

25 image with a high degree of certainty. 
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Normally, it is very likely that the image of a subject 
to be photographed is located within an area that is in a 
focus -verified state. Since mainly areas in such a focus - 
verified state are set as evaluation areas according to the 
5 present invention, acceptability evaluation of the subject 
image can be executed with a high degree of accuracy. 

Under normal circumstances, it is highly likely that the 
image of a subject to be photographed is located inside an area 
that has been manually or automatically selected as a 

10 photometric area. Thus, by ascertaining the correlation 

between the photometric areas and the evaluation areas, it is 
possible to efficiently and quickly determine either a 
photometric area or an evaluation area in correspondence to 
the other. In addition, since a single area setting device 

15 can be utilized for setting both types of areas, that portion 
of the structure of the image processing apparatus that is 
involved in the setting of the two types of areas can be further 
simplified. 

Normally, it is highly likely that the image of a subiect 
30 to be photographed is located in an area that has been manually 
or automatically selected as a focal point detection area. 
Consequently, by ascertaining the correlation between the 
focal point detection areas and the evaluation areas, it is 
possible to efficiently and quickly determine either a focal 
25 point detection area or an evaluation area in correspondence 
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to the other. la addition, since a single area setting device 
can be utilized for setting both types of areas, that portion 
of the structure of the image processing apparatus that is 
involved in the setting of the two types of areas can be further 
5 simplified. 

When the photographer has fixed the focal adjustment or 
the exposure adjustment via a locking device, he is likely to 
change the image plane layout by changing the direction in which 
the image - capturing device face* prior to photographing . When 

10 the image plane layout is changed in this manner, it is likely 
that the subject is not present inside any of the evaluation 
areas set in advance, which results in a lower degree of 
reliability in the results of the acceptability evaluation, 
in order to solve this problem, the image processing apparatus 

IS described above clears the evaluation area setting or resets 
a new evaluation area when the focal adjustment or the exposure 
adjustment has been fixed, to avoid any reduction in the degree 
of reliability in a timely manner. 

Another image processing apparatus having an image 

20 selecting function, comprises: an image -capturing device that 
continuously captures images of a subject; an evaluation 
device that takes in a plurality o£ sets of image data obtained 
at the image -capturing device through continuous image - 
capturing and performs acceptability evaluation on each of the 

25 plurality of sets of image data; an acceptability selection 
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device that selects image data ranked high in the acceptability 
eval-uation among- the plurality of sets of image data having 
undergone the acceptability evaluation performed at the 
evaluation device and records the image data into a recording 
5 medium; and a frame number changing device that changes a number 
of frames over which continuous image -capturing is performed 
at the image- capturing device. 

In this image processing apparatus, preferably, the 
frame number changing device stops a continuous image - 
10 capturing operation performed by the image -capturing device 
when an evaluation made by the evaluation device indicates one 
of a value greater than a specific upper limit value, a value 
less than a specific lower limit value and a relative maximum 
value. 

15 Also, preferably, the image processing apparatus 

further comprises a framing detection device that detects a 
framing change at the image - capturing device, and the frame 
number changing device stops a continuous image -capturing 
operation by the image- capturing device when the framing 

20 change is detected by the framing detection device. 

Also, preferably, the frame number changing device 
allows a continuous image- capturing operation to be resumed 
at the image - capturing device when none of evaluations made 
by the evaluation device reach a specific threshold value. 

25 since a frame number changing device is provided in the 
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present invention, tlie number of frames for a continuous 
image -capturing operation performed by the image -capturing 
device can be varied ia a flexible manner in correspondence 
to the specific photographing states, the photographing skills 
5 of the photographer and the like. 

Generally speaking, the cruality of image that can be 
achieved through image -capturing is greatly affected by the 
photographing conditions and the image -capturing skills of the 
photographer. Thus, if the number of freunes for continuous 

10 image -capturing is fixed in advance, a problem occurs in that 
the number of frames is not sufficient to capture a good quality 
image or the number of frames is too large so that there is 
an excess resulting in an overly long photographing time. 
However, in the structure described above, the evaluation made 

15 by the evaluation device is monitored and, depending upon the 
results of the evaluation, continuous image -capturing is 
automatically stopped. Consequently, the number of frames is 
automatically adjusted in correspondence to the photographing 
state, the photographing skills of the photographer and the 

20 like, to solve the problem described above. 

When there is a change in the framing resulting from the 
subject moving out of the image plane or the like, the 
composition of continuous image data changes in the middle. 
If the composition changes in the middle in this manner, it 

25 is difficult to perform acceptability evaluation based upon 
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the same conditions, and ultimately, accurate comparison of 
a series of sets of imag« data cannot be performed for 
appropriate selection. In addition, tlie photographer may lose 
interest in the subject and may decide to intentionally change 
5 the freuning by lowering the camera or the like. According to 
the present invention, swch a change in the framing is detected 
to stop continuous image- capturing . consequently, 
continuous image- capturing is not sustained to no purpose and 
is stopped rationally, 

10 situations in which no good image data are obtained after 

a continuous image- capturing operation is completed should be 
expected to arise occasionally. In such a case, the task of 
comparing imag« data and selecting a good image among them 
itself is meaningless- Thus, according to the present 

X5 invention, if none of the evaluations made at the evaluation 
device reaches a preset threshold value, the continuous 
image -capturing operation is performed again. By performing 
such an operation, it becomes possible to achieve a comparative 
selection for a good image while assuring that good image data 

20 have been obtained through image- capturing with a high degree 
of certainty. 

An image processing apparatus according to the present 
invention having an evaluation display function, comprises: 
an evaluation device that takes in a plurality of sets of image 
25 data obtained through continuous image- capturing and performs 
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acceptability evaluation on each of the plurality of sets of 
image data; a display device that displays image data together 
with evaluations of the image data made by the evaluation 
device; a selection operation device that accepts an external 
5 image selection operation that is performed to select one set 
of image data among the image data brought up on the display 
device; and a selection recording device that records the image 
data selected via the selection operation device into a 
recording medium. 

10 In the structure described above, the image- capturing 

device performs continuous image -capturing to obtain image 
data corresponding to a plurality of frames in a single 
photographing operation. The evaluation device evaluates the 
acceptability of the photographing state, the acceptability 

IS of the image quality or the like for individual sets of such 
image data. The selection operation device displays both the 
image data and the results of the acceptability evaluations. 
The photographer engages in an image selection operation by 
referring to the display to accurately select imag* data 

20 obtained in a good photographing state for storage. 

Another image processing apparatus having an evaluation 
display function, comprises: an evaluation device that takes 
in a plurality of sets of image data obtained through continuous 
image -capturing and performs acceptability evaluation on each 

25 of the plurality of sets of image data; a display device that 
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displays a plurality of sets of image data in a order of 
evaluation rankings in the acceptability evaluation made by 
the evaluation device; a selection operation device that 
accepts an external image selection operation that is 
5 performed to select one set of image data aunong the image data 
brought up on the display device; and a selection recording 
device that records the image data selected via the selection 
operation device into a recording medium. 

In the structure described above, the image -capturing 

10 device performs continuous image -capturing to obtain image 
data corresponding to a plurality of frames in a single 
photographing operation. The evaluation device evaluates the 
acceptability of the photographing state, the acceptability 
of the image quality or the lilce for individual sets of such 

IS image data. The selection operation device displays the image 
data in the order of rankings in the acceptability evaluation. 
The photographer engages in an image selection operation by 
referring to the display to accurately select image data 
obtained in a good photographing state for storage. 

20 Another image processing apparatus having an evaluation 

display function, comprises; an evaluation device that 
performs acceptability evaluation on image data obtained 
through image- capturing; and a display device that displays 
an image based upon the image data together with the evaluation 

25 made by the evaluation device. 
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In this image processing apparatus, preferably, the 
display device displays a highest evaluation made by the 
evaluation device together with a most recent evaluation made 
by the evaluation device. 
5 in the structure described above, the acceptability of 

the photographing state at image -capturing is displayed on the 
display device (monitor) - Thus, the photographer can refer 
to the display on the display device to correct the 
photographing state for subseciuent photographing toward a more 

10 desirable result with ease. It is to be noted that the 

structure described above, in which image- capturing may be 
performed intermittently, is capable of performing a standard 
image -capturing operation in which pictures are taken one 
frame at a time. During such an image -capturing operation, 

15 too, the photographer can correct the photographing state for 
a subsequent photographing operation for a better result with 
ease by referring to the results of the evaluation of the 
preceding frame in a similar manner. 

In the structure described above, the photographer can 

20 easily correct the photographing state for subsequent 

photographing toward a better result by comparing the highest 
evaluation and the most recent evaluation. 

Another image processing apparatus having an image 
selecting function, comprises: a compression device that 

25 engages in compression processing on image data; an evaluation 
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device that controls the compression device to compresses a 
plurality of 3«t8 of image data obtained through continuous 
image -capturing by using a compression pareuneter for 
acceptability evaluation and performs acceptability 
5 evaluation on each set of image data based upon a resulting 
post -compression code volume; and an acceptability selection 
device that selects image data ranked high in the acceptability 
evaluation among the plurality of sets of image data having 
undergone the acceptability evaluation at the acceptability 

10 evaluation device and records the selected image data into a 
recording medium in a state in which the selected image data 
are compressed via the compression device to achieve a target 
post- compression code volume for image recording. 

In this image processing, preferably, the acceptability 

15 selection device makes a decision as to whether or not a 

post- compression code volume of the image data that have been 
selected, achieved in the acceptability evaluation is within 
an allowable range for a target post -compression code volume 
for image recording, and records compressed data resulting 

20 from the acceptability evaluation if the post -compression code 
volume is within the allowable range, hut re -compresses the 
image data that have been selected to achieve the target 
post -compression volume for image recording and records the 
re -compressed image data if the post -compression code volume 

25 is not within the allowable range. 
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Also, preferably, the compression device 

determines a compression parameter to be used for re- 
compression to achieve the target post-compression volume for 
image recording based upon results of the compression 
processing performed during the acceptability evaluation. 

In the structure described above, the evaluation device 
employs a compression device to compress the image data using 
a compression pareuneter for the acceptability evaluation <the 
parameter used in a compression arithmetic operation that 
determines the compression ratio) for the individual sets of 
image data. Since image data obtained through continuous 
image -capturing normally have similar picture compositions, 
the post -compression code volumes are approximately e^al to 
one another eonong these images. However, if camera vibration 
blur, the subject -motion blur or blur caused by poor focus or 
the like occurs in some image data, the high frequency component 
in the spatial freguency dissipates, thereby correspondingly 
reducing the post-compression code volume. Thus, the 
evaluation device evaluates data with a greater post- 
compression code volume as better quality image data. The 
acceptability selection device selects better quality image 
data in conformance to such an evaluation criterion and records 
them- 

Through the operation described above, image data 
obtained in a good photographing state can be selectively 
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stored according to the present invention. In particular, the 
compression device which is normally employed for recording 
is utilized to execute the processing for acceptability 
evaluation. Consequently, a separate processing mechanism 
5 dedicated to acceptability evaluation is not required, 
achieving simplification of the apparatus structure. 

In addition, according to the present invention, a 
special compression pareuneter that is not used for recording 
is used for image compression for the acceptability evaluation. 

10 Under normal circumstances, i£ the compression factor setting 
for recording is extremely high, a great quantity of the high 
frequency component in the spatial frequency is lost during 
the compression stage, causing the post- compression code 
volume to vary little among different images. Xf , on the other 

15 hand, the compression factor setting for recording is 

extremely low, very small amplitude signals such as dark 
current noise and fixed pattern noise become coded {quantized) 
as high frequency components . Consequently, in this case, too, 
the post -compression code volumes do not greatly vary among 

20 different images. 

The phenomena described above may result in difficulty 
in performing acceptability evaluation since no significant 
differences manifest among the post -compression code volumes 
if the acceptability evaluation is performed using the results 

25 of the image compression implemented during the recording 
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operation. However, according to the invention described 
above, a special compression parameter is used for the 
acceptability evaluation. As a result, it is possible to set 
the compression factor in the medium range, which is suitable 
for the acceptability evaluation, separately from the 
compression factor for recording. Thus, accurate 
acceptability evaluation can be executed with a high degree 
of reliability independently of the compression factor setting 
for recording. 

According to the present invention, if the code volume 
of compressed data having undergone acceptability evaluation 
is appropriate for recording, the compressed data are recorded. 
Conse<iuently, the recompression processing for recording can 
be omitted to achieve a reduction in the length of time required 
to implement the overall processing. 

Under normal circumstances, several trial compressions 
must be performed and the compression parameter must be 
corrected in order to ensure that the post -compression code 
volume for recording is set within a target range. However, 
according to the present invention, the results of the 
compression performed during the acceptability evaluation 
constitutes a trial compression so that the number of trial 
compressions that need to be performed for recording can be 
reduced with a high degree of reliability. 

Another image processing apparatus according to the 
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present invention comprises: an image - capturing device that 
captures an image of a subject; a recording device that records 
image data obtained througli image -capturing performed by the 
image -capturing device; a photographic evaluation device that 
evaluates acceptability of a photographing state in which the 
image data have been obtained through image- capturing 
performed by the image -capturing device; a mode setting device 
that, in response to an external operation, sets or clears {!) 
an acceptability selection mode in which image data with a high 
evaluation from the photographic evaluation device among image 
data obtained through continuous image' capturing performed by 
the image -capturing device are selectively recorded and (2) 
a continuous shooting mode in which image data corresponding 
to a plurality of frames obtained through continuous 
image -capturing performed by the image -capturing device are 
all recorded, to determine a photographing sequence that 
corresponds to a current mode setting; and a photographic 
control device that implements control on the image -capturing 
device and the recording device in conformance to the 
photographing sequence determined by the mode setting device 
and executes photographing. And the mode setting device 
implements control of setting to ensure that even if an 
instruction is issued through an external operation for a 
setting whereby the acceptability selection mode and the 
continuous shooting mode overlap each other the acceptability 
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selec1:lon mode and. the continuous shooting mode do not overlap 
in setting. 

In this image processing appa.ratus, preferably, the mode 
setting device implements control to ensure that if an external 
operation is performed to set either the continuous shooting 
mode or the acceptability selection mode while the other mode 
is set, the external operation is not accepted. 

Also, preferably, the mode setting device implements 
control to ensure that if the continuous shooting mode and the 
acceptability selection mode are set overlapping each other, 
either mode that has been set earlier, is automatically cleared. 
In this case< preferably, the mode setting device reverts to 
the mode set earlier and automatically cleared, if an external 
operation clears over lapping of mode settings. 

Another image processing apparatus according to the 
present invention comprises: an image -capturing device that 
captures an image of a subject; a recording device that records 
image data obtained through image -capturing performed by the 
image -capturing device; a photographic evaluation device that 
evaluates acceptability of a photographing state in which the 
image data have been obtained through image -capturing 
performed by the image -capturing device; a mode setting device 
that, in response to an external operation, sets or clears (1) 
an acceptability selection mode in which image data with a high 
evaluation from the photographic evaluation dsvice among image 
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data obtained through continuous image - capturing performed by 
the image- capturing device are selectively recorded and (2) 
a continuous shooting mode in which image data corresponding 
to a plurality of frames obtained through continuous 
5 image- capturing performed by the image -capturing device are 
all recorded/ to determine a photographing sequence that 
corresponds to a current mode setting; and a photographic 
control device that implements control on the image -capturing 
device and the recording device in conformance to the 

10 photographing sequence determined by the mode setting device 
and executes photographing. And the photographic control 
device executes a photographing sequence selected in 
correspondence to a mode given higher priority in conformance 
to a predetermined priority order even if the acceptability 

IS selection mode and the continuous shooting mode are set 
overlapping each other througi an external operation. 

Normally, when an acceptability selection mode and a 
continuous shooting mode are set at the seune time, an 
acceptability selection operation is executed for the 

20 individual freunes photographed through the continuous 

shooting operation ( image- capturing for a plurality of frames 
-> acceptability selection), thereby causing a problem of a 
serious reduction in the continuous shooting speed. As a 
solution, in the structure described above., one of (Bl) ~ (B3) 

25 below is implemented as a device to ensure that the 
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acceptability selection mode and the continuous shooting mode 

are prevented from being set at the same time. 

(Bl) Prohibition of acceptance of an external operation 

The mode setting device prohibits (rejects, disregards 
5 or invalidates) acceptance of an external operation if the 
acceptability selection node and the continuous shooting mode 
overlap. AS a results the continuous shooting mode cannot be 
set after the acceptability selection mode has been set. 
Likewise, the acceptability selection mode cannot be set in 
10 a state in which the continuous shooting mode is already set. 
Thus, the acceptability selection mode and the continuous 
shooting mode are never set concurrently, thereby eliminating 
problems caused by the two modes being used at the same time 
with a high degree of reliability. In particular, during such 
15 an operation, the acc«ptance of an external operation is 

prohibited at the point in time at which the external operation 
is attempted by the photographer. This prompts awareness on 
the part of the photographer that these modes cannot be set 
at the same time. 
20 (B2) Automatic clearing of either mode 

The mode setting device automatically (forcibly) clears 
at least one of the modes when the acceptability selection mode 
and the continuous shooting mode overlap. This ensures that 
the acceptability selection mode and the continuous shooting 
25 mode arft never set at the same time, thereby eliminating 
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problems caused by the two modes being used together with a 
high degree of reliability. In particular, during such an 
operation, by giving priority to the mode to be set anew and 
automatically clearing the mode that was previously set, the 
5 most recent photographing intention of the photographer can 
be accurately reflected in the mode setting of the image 
processing apparatus. In addition, in this case, the 
photographer is not required to clear the previous mode that 
was set before any problems occur due to the setting of the 

10 new mode. As a result, the operability in mode setting further 
improves. Moreover, during such an operation, by fixing one 
specific mode as the mode to be automatically cleared 
regardless of the sequence of external operations, the 
priority order of the modes can be determined in advance. For 

15 instance, by setting the acceptability selection mode as the 
mode to be automatically cleared when the acceptability 
selection mode and the continuous shooting mode overlap, the 
continuous shooting mode can be given priority over the 
acceptability selection mode for execution at all times. 

20 

(B3) Photographing sequence unaffected by mode setting 

The mode setting device ensures that when the 
acceptability selection mode and the continuous shooting mode 
overlap, the state in which these modes are set concurrently 
25 is not reflected in the photographing sequence. Thus, even 
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if the two modes are set at the same time, the photographing 
sequence in. the acceptability selection mode and the 
photographing seguence in the continuous shooting mode are not 
executed simultaneously, thereby eliminating problems 
5 resulting from the two modes being used at the same time with 
a high degree of reliability. This may be achieved by 
determining the priority order of the modes in advance and by 
executing the mode given higher priority first. 

Another image processing apparatus according to the 
10 present invention comprises: an image -capturing device that 
captures an image of a subject; a recording device that records 
image data obtained through image -capturing performed by the 
image -capturing device; a photographic evaluation device that 
evaluates acceptability of a photographing state in which the 
15 image data have been obtained through image -cap taring 

performed by the image- capturing device; a mode setting device 
that, in response to an external operation, sets or clears (1) 
an acceptability selection mode in which image data with a high 
evaluation from the photographic evaluation device among image 
20 data obtained through continuous image- capturing performed by 
the image -capturing device are selectively recorded and (2) 
a light emission mode in which light emission is performed 
automatically or unconditionally by controlling an external 
or internal flash unit at image -capturing by the image- 
25 capturing device, to determine a photographing sequence that 
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corresponds to a current mode setting; and a photographic 
control device that implements control on the image -capturing 
d«vice and the recording device in conformance to the 
photographing sequence determined by the mode setting device 
5 and executes photographing. And the mode setting device 
implements control of setting to ensure that even if an 
instruction is issued through an external operation for a 
setting whereby the acceptability selection mode and the light 
emission mode overlap each other the accept3a>ility selection 
10 mode and the continuous shooting mode do not overlap in setting , 
In this image processing apparatus , preferably, the mode 
setting device implements control to ensure that if an external 
operation is performed to set either the light emission mode 
or Che acceptability selection mode while the other mod© is 
15 set, the external operation is not accepted. 

Also, preferably, the mode setting device implements 
control to ensure that if the light emission mode and the 
acceptability selection mode are set overlapping each other, 
either mode that has been set earlier is automatically cleared. 
20 In this case, preferably, the mode setting device reverts to 
the mode set earlier and automatically cleared, if an external 
operation clears overlapping of mode settings. 

Another image processing apparatus according to the 
present invention comprises: an image- capturing device that 
25 captures an image of a subject; a recording device that records 
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image data obtained through image -capturing performed by the 
image -capturing device; a photographic evaluation device that 
evaluates acceptability of a photographing state in which the 
image data have been obtained through image -capturing 
performed by the image -capturing device; a mode setting device 
that, in response to an external operation, sets or clears (1> 
an acceptability selection mode in which image data vith a high 
evaluation from the photographic evaluation device among image 
data obtained through continuous image- capturing performed by 
the image- capturing device are selectively recorded and (2> 
a light emission mode in which light emission is performed 
automatically or unconditionally by controlling an external 
or internal flash unit at image -capturing by the image- 
capturing device, to determine a photographing seciuence that 
corresponds to a current mode setting; and a photographic 
control device that implements control on the image -capturing 
device and the recording device in conformance to the 
photographing segiience determined by the mode setting device 
and executes photographing. And the photographic control 
device executes a photographing sequence selected in 
correspondence to a mode given higher priority in conformance 
to a predetermined priority order even if the acceptability 
selection mode and the light emission mode are set overlapping 
each other through an external operation. 

Noannally, when the acceptability selection mode and the 
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light emission mode are set at the same time, a charge standby 
period for light emission is inserted after each frame during 
a continuous image -capturing operation performed in the 
acceptability selection mode. This causes a problem in that 
5 the acceptability selection mode cannot be executed smoothly 
and quickly. In addition, during a flash photographing 
operation performed, at night when the exposure time (light 
emission time) is extremely short, in particular, a camera 
vibration blur or a subject -motion blur does not occur readily 

10 and thus, the need to set the acceptability selection mode is 
not great. For these reasons, one of (CI) - (C3) below is 
implemented in the structure described above as a device for 
ensuring that the acceptability selection mode and the light 
emission mode are not set at the same time. 

X5 (CI) Prohibition of acceptance of external operation 

When the acceptability selection mode and the light 
emission mode overlap, the mode setting device prohibits 
(rejects, disregards or invalidates) acceptance of a mode 
setting operation. Consequently, the light emission mode 

20 cannot be set after the acceptability selection mode has been 
set. Likewise, the acceptability selection mode cannot be set 
after the light emission mode has been set. As a result, the 
acceptability selection mode and the light emission mode are 
not set at the same time, thereby eliminating problems 

25 resulting from the two modes being used at the seune time with 
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a high degree of reliability. In particular, during such an 
operation, the acceptance of an external operation ie 
prohibited at the point in time at which the external operation 
is attempted by the photographer. This prompts awareness on 
the part of the photographer that these modes cannot be set 
at the same time. 

(C2) Automatic clearing of either mode 

The mode setting device automatically (forcibly) clears 
at least one of the modes when the acceptability selection mode 
and the light emission mode overlap. This ensures that the 
acceptability selection mode and tlie light emission mode are 
never set at the same time, thereby eliminating problems caused 
fay the two modes being used together with a high degree of 
reliability. In particular, during such an operation, by 
giving priority to the mode to be set anew and automatically 
clearing the mode that was previously set, the most recent 
photographing intention of the photographer can be accurately 
reflected in the mode setting of the image processing apparatus. 
In addition, in this case, the photographer is not required 
to clear the previous mode that was set before any problems 
occur due to the setting of the new mode. As a result, the 
operability in mode setting further improves. Moreover, 
during such an operation, by fixing one specific mode as the 
mode to be automatically cleared regardless of the sequence 
of the external operation, the priority order of the modes can 
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be detejrmined in advance. For instance, by setting the 
acceptability selection mode as the mode to be antomatically 
cleared when the acceptability selection mode and the light 
emission mode overlap, the light emission mode can be given 
5 priority over the acceptability selection mode for execution 
at all times . 

(C3) Photographing sequence unaffected by mode setting 

The mode setting device ensures that when the 
acceptability selection mode and the light emission mode 

10 overlap, the state in which these modes are used together is 
not reflected in the photographing secpience. Thus, even if 
the two modes are set at the same time, the photographing 
sequence in the acceptability selection mode and the 
photographing sequence in the light emission mode are not 

15 executed simultaneously, thereby eliminating problems 

resulting from the two modes being used at the same time with 
a high degree of reliability. This may be achieved by 
determining the priority order of the modes in advance and by 
executing the mode given higher priority first. 

20 Under normal circumstances, the continuous shooting 

mode or the like is often used only temporarily in a specific 
photographing situation, in such a case, the photographer can 
manually clear the problematic mode to eliminate any problems 
resulting from modes being set concurrently- At this point, 

25 if the mode setting device has separately cleared the mode on 
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a temporary basis automatically, the mode desired by the 
photographer may not be restored. However, according- to the 
present invention, the "automatic mode clearance^' is also 
reverted to the previous state in this case. Thus, it is 
5 possible to shift to the mode setting intended by the 
photographer with a high degree of reliability. 

A recording medium according to the present invention 
has a control program to be utilized at an image processing 
apparatus having an image selecting function recorded therein. 

10 The control program comprising; an instruction for talcing in 
& plurality of sets of image data of a subject obtained through 
image -capturing; an instruction for performing acceptability 
evaluation on each of the plurality oS sets of image data; and 
an instruction for selecting image data ranked high in the 

15 acceptability evaluation among the image data having undergone 
the acceptability evaluation. 

A data signal embodied in a carrier wave according to 
the present invention comprises a control program for use by 
an image processing apparatus having an image selecting 

20 function. The control progrzun comprising: an instruction for 
taking in a plurality of sets of image data of a subject obtained 
through image -capturing: an instruction for performing 
acceptability evaluation on each of the plurality of sets of 
image data; and an instruction for selecting image data ranked 

25 high in the acceptability evaluation among the image data 
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having undergone the acceptability evaluation. 

In recent years, an image processing apparatus (for 
example an electric camera) is often constituted as a system 
comprising an image -capturing unit, an information processing 
5 unit (which includes a computer and a palm- size electronic 
notepad) and the like. Thus, the image processing apparatus 
described above can be achieved by providing a program that 
achieves the functions of the evaluation device and the 
acceptability selection device described above on a recording 

10 medium for the information processing unit in the system 
configuration described above . 

Is addition, a system may be achieved in a computer 
■whereby image data are taken into the computer from an electric 
camera, a communication medium, a recording medium, a scanner, 

15 a separate program or the like to execute acceptability 

selection on these image data. A program can be provided for 
the computer in such a system through the recording medium 
described above, too. 

These programs may be also provided by a signal embodied 

20 in a carrier wave through a communication line such as the 
internet. 



BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a block diagram illustrating the structure of 
25 the electronic camera in a first embodiment; 
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FIG. 2 illustrates the main routine implemented in the 
first embodiment; 

PIGS. 3A through 3D present routines for setting 
evaluation areas; 

PIG. 4 illustrates a routine for setting evaluation 

areas ; 

FIGS. 5A through. 5C illustrate examples of positions of 
the various types of areas; 

FIG. 6 illustrates the decision -making routine 
implemented with regard to the image -capturing stop 
condition*; 

FIG. 7 illustrates the acceptability evaluation 
routine; 

FIG. 8 Illustrates the routine for displaying the 
selection screen; 

FIG. 9 presents examples of the selection screen display; 

FIG. 10 illustrates the main routine implemented in a 
second emboditti«nt ; 

FIG. 11 illustrates the image compression routine 
implemented for acceptability evaluation; 

FIG. 12 illustrates the finder display routine; 

FIG. 13 presents aui example of finder display: 

FIG. 14 illustrates the routine implemented for image 
overwrite recording; 

PIG. 15 illustrates the structure of the image selection 
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system employing a computer achieved in a third embodiment; 

FIG. 16 illustrates the main routine implemented in the 
program; 

FIG. 17 illustrates the routine for setting evaluation 

5 areas ; 

FIG, 18 is a block diagram illustratiagr the structure 
of the electronic camera in a fourth embodiment; 

FIG. 19 is an external view illustrating the positions 
of the operating members in the electronic camera; 
10 FIG. 20 is a flowchart illustrating the operation of the 

microprocessor in the fourth embodiment; 

FIG. 21 is a state transition diagram illustrating 
changes in the mode setting in the fourth embodiment; 

FIG. 22 is a state transition diagram illustrating 
15 changes in the mode setting in a fifth embodiment; 

PIG. 23 is a flowchart illustrating the operation of the 
microprocessor in a sixth embodiment; 

FIG . 24 illustrates how a program may be provided through 
a telecommunication line; and 
20 FIG. 25 illustrates a camera having a camera vibration 

correction mechanism in the prior art. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 
{First Embodiment) 
25 In the first embodiment, an electronic camera that 
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performs acceptability evaluation and image selecting after 
completing a continuous image- capturing operation is achieved. 
The acceptability evaluation means evaluating whether or not 
the image is good. FIG. 1 is a block diagram illustrating the 
5 structure of an electronic camera 10. In FIG. 1, at the front 
surface of the electronic camera 10, a taking lens 12 is mounted. 
The light receiving surface of an image -capturing element 14 
is positioned toward the image space of the taking lens 12 via 
a mirror box 13 . A finder optical system 13a is provided along 

10 the direction of the reflection of the mirror box 13. 

An image output from the image - capturing element 14 is 
stored in an image memory l6 via an image processing unit 15 
which engages in color signal processing, A/D conversion, 
gamma correction and the like. In addition, an image 

15 compression unit 17 and an image display circuit 24 are 

connected to the data bus of the image memory 16. The image 
compression unit 17 is connected to a microprocessor 18, and 
a memory card 2 0 is detachably connected to the microprocessor 
18 via a card interface 19. 

20 The microprocessor 18 is further connected with a CCD 

drive circuit 21 provided to implement control of the 
image -capturing element 14, a viewfinder display unit 22 
provided to implement display within the viewfinder. a 
photometric unit 23 that measures the brightness of a subject, 

25 the image display circuit 24, a flash unit 26 and the like. 
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An image output from the image display circuit 24 is supplied 
to a monitor display unit 2 5 provided at the rear surface of 
the casing of the electronic camera 10. 

In addition, operating members such as an operating 
5 button group 27 and a shutter release button 30 are provided 
at the casing of the electronic camera 10. Outputs from these 
operating members are all supplied to the microprocessor 18. 
A focal point detection unit 31 is provided under the mirror 
box 13 . Focal point detection data output by the focal point 

10 detection unit 31 are provided to the microprocessor 18. The 
microprocessor 18 is further connected with a lens drive 
mechanism 32 that drives a focus lens group of the taking lens 
12 back and forth and an encoder 33 that detects the position 
of the focus lens group at the taking lens 12 , 

15 (Overview of the Main Routine) 

One of the photographing modes that may toe set at the 
electronic camera 10 is a mode for recording image data having 
undergone acceptability selection (hereafter referred to as 
"acceptability selection mode") . Normally, image data 

20 resulting from an image -capturing operation are recorded in 
a recording medium such as a memory card after they undergo 
a specific type of image processing in units of captured images . 
However, in the acceptability selection mode. axi. image - 
capturing operation is performed on a subject continuously 

25 under specific conditions, the acceptzQjility of image data 
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resulting from the continuous image -capturing operation is 
judged and the beat image among the image data having undergone 
the decision-making is selected to be recorded in the recording 
medium. 

5 In other words, in a single scene which is cohesive over 

time^ a plurality of images are captured as captured image 
candidates of this scene and a good image among them is selected 
to be recorded at the recording medium as the image of the scene. 
While a subject image is captured continuously in a similar 

10 manner in the continuous shooting mode which is set when 

capturing the image of a moving subject, it differs from the 
acceptability selection mode in that the individual sets of 
image data resulting from the continuous image -capturing 
operation in the continuous shooting mode are all recorded, 

15 ?1G. 2 shows the main routine executed by the microprocessor 
when the acceptability selection mode is set. The schematic 
flow of the main routine is explained below before the operation 
is explained in detail. 

First, in response to a switching operation at the 

20 operating switch group 27. the microprocessor 18 sets various 
modes including a photometric mode, a focal point detection 
mode and the acceptability selection mode (step Si) . Next, 
the microprocessor 18 executes the routine for setting 
evaluation areas (to be detailed later) to set evaluation areas 

25 (step S2) . The microprocessor IS repeats these operations 
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until the sh-Utcer release button 30 is pressed (step S3 NO) . 
If the shutter release button 30 is pressed by the user in this 
State (step S3 YES) , the microprocessor 18 drives the 
image - capturing element 14 via the CCD drive circuit 21 to 
5 execute an image -capturing operation for one frame (step S4) . 

Next, the microprocessor 18 executes the decision- 
making routine with regard to the image -capturing stop 
conditions (to be detailed later) to make a decision as to 
whether or not the continuous image -capturing operation is to 

10 be stopped (step S5) . If it is decided that the stop flag has 
been reset (cleared) through this dec is ion -making routine 
(step S6 NO) , the microprocessor 18 returns to the operation 
in step S4 to repeat the continuous image - capturing . 

If, on the other hand, the atop flag has been set (step 

15 S6 YES), the microprocessor 18 executes the acceptability 
evaluation routine (to be detailed later) in which 
acceptability evaluation is performed for all the image data 
resulting from the continuous image -cap Curing operation (step 
S7) . A specific length of time determined by the exposure time 

20 and the image processing time is set for the time intervals 
elapsing between individually captured images during 
continuous imago- capturing . For example, two through thirty 
frames may be captured per second. 

Next, the microprocessor 18 makes a decision as to 

25 whether or not at least one set of the acceptability evaluation 
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results exceeds a preset threshold value (step S8) . If none 
of the acceptability evaluations are equal to or greater than 
the threshold value (step S8 NO) , the microprocessor 18 returns 
to the operation in step S4 to perforin continuous image - 
5 capturing again. 

X£ there is an acceptability evaluation exceeding the 
threshold value, on the other hand (step S8 YES), the 
microprocessor 18 decides that good image data have been 
captured to shift to the next image selecting operation, 

10 During the image selecting operation, the 

microprocessor 18 makes a decision as to whether or not a good 
image selection is to be performed o» the screen by judging 
the operating conditions in the acceptability selection mode 
(step S9) . At this time, if the user has already selected 

15 operating conditions for selecting the image on the screen 
(step S9 YES) , the microprocessor 18 executes the selection 
screen display routine (to be detailed later) . As a result, 
the "thumbnail display of image data obtained through 
continuous image -capturing" and the **ran)cing of acceptability 

20 evaluation" are displayed together overlapping at the display 
unit 25 (step SIO) . 

The user manually selects one set of image data on the 
display unit 25 as a good image by operating the operating 
button group 27 or the like (step Sll) . After accepting the 

25 manual selection of the good image, the microprocessor 18 
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shifts to the operation in step S13 . If, on the other hand, 
operating conditions for automatically selecting an image are 
selected in step S9 {step S9 NO) , the microprocessor 18 selects 
the image data that are first in the ranking of acceptability 
5 evaluation as a good Image <step S12) . 

The microprocessor 18 compresses the good image selected 
in step Sll or step S12 in this manner and records the compressed 
image data at the memory card 20 via the card interface 19. 
Through the series of operations described above, the 
10 photographing operation in the acceptability selection mode 
is completed. 

Next, the details of the various sub -routines mentioned 
above are individually explained. 

(Evaluation Area Setting Routine) 
15 In FIGS. 3A through 3D and 4, several examples of the 

evaluation area setting routine are presented. The following 
is an explanation of these examples, given in the order that 
they are presented. 

(Setting routine in FIG. 3A) 
20 First, the microprocessor 18 sets a photometric area as 

described below in correspondence to the type of photometric 
mode set by the photographer (step S20) . 

1) Spot photometric mode: An area (a) In PiG. 5A is set as the 
photometric area. 
25 2) Centrally weighted photometric mode: Areas (a) and (b) in 
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FIG, SA are set as photomebric areas (the area (a) is weighted 
greater tiian the area (b) ) . 

3) Multi -photometric mode: Among areas (a) - (f) in FIG. 5A, 
a light area (EVll or higher) and a dark area (EV3 or lower) 
5 where the gradation reproducibility is reduced are excluded, 
and the remaining areas are set as photometric areas . 

Next, the microprocessor 18 uses the photometric areas 
thus set and their evaluation weighting unchanged to determine 
the evaluation areas (step 21) . 

10 (Setting routine in FIG. 3B> 

Within the photographic image plane of the electronic 
camera 10, five areas (g) ~ {k> where focal point detection 
is possible are set in advance as shown in FIG. 5B. The 
photographer can select a desired focal point detection area 

IS from the areas (g) - (k) by operating the operating button group 
27. Alternatively, the microprocessor 18 may identify the 
area where the Closest subject is located based upon the focal 
point detection data corresponding to the individual areas to 
automatically select the area as a focal point detection area. 

20 Furthermore, the focal point detection area may be changed in 
conformance to the movement of a moving subject by adopting 
the focal point detection technology of the known art. The 
microprocessor 18 sets an evaluation area at the current 
position of the focal point detection area selected in this 

25 manner (step S22) . 
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(Setting routine in PIG. 3C) 

First, the microprocessor 18 takes in the photometric 
values obtained at several points within the image plane from 
the photometric unit 23 . Based upon these photometric values, 
5 the microprocessor 18 excludes the light areas and. the dark 
areas from the photographic image plane and creates a correct 
exposure area (step S23) . The microprocessor 18 then seta the 
correct exposure area thus created as an evaluation area (step 
S24) . 

10 (Setting routine in FIG. 3D) 

The microprocessor 18 first performs decidion-making 
with regard to focus matching at several points within the image 
plane via the focal point detection unit 31 and prepares a 
focus -verified area (step S25> . The microprocessor 18 then 

15 sets the focus- verified area thus prepared as an evaluation 
area (step S2S) . It is to be noted that . such setting of an 
evaluation area does not need to be performed only during the 
execution of automatic focal point control, but may be 
performed during manual focal adjustment or during focus aid. 

20 (Setting routine in FIG, 4) 

First, the microprocessor 18 ascertains the switching 
state at the operating button group 27 and makes a decision 
as to whether or not an operation for locking the focal 
adjustment (so-called AF lock) has been performed by the 

25 photographer (step S30) . If AF lock has not been implemented. 
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the microprocessor 18 sets the area selected for focal point 
detection as an evaluation area <step S31) . 

If, on the other hand, AT lock has been implemented, it 
is likely that the photographer wishes to change th* framing 
5 in order to change the image composition. For this reason, 
the microprocessor 18 clears the current evaluation area 
setting {step S32) . Next, the microprocessor 18 ascertains 
the switching state at the operating button group 27 to make 
a decision as to whether or not an operation for locking the 

10 exposure adjustment {so-called AE lock) has been performed by 
the photographer (step S33) . 

At this point, if AE lock has been implemented, it is 
likely that the photographer wishes to change the framing in 
order to change the image composition. For this reason, the 

15 microprocessor 18 does not set an evaluation area range at this 
point and instead, reset* the entire image plane as the 
evaluation area (step S34) . If , on the other hand, AE lock 
has not been implemented, the microprocessor 18 sets the area 
selected for photometry as the evaluation area (steps S35 - 

20 S39) . 

{Image -capturing stop condition decision-making 
routine) 

Next, the image -capturing stop condition decision- 
making routine is explained. FIG. 6 illustrates the 
25 image -capturing stop condition decision-making routine. 
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When this decision- making routine is started up f roai the main 
routine, the microprocessor 18 first identifies the ;»ode 
setting for the number of frames for image - capturing (stepS41) . 
At this point, if the fixed frame nimber mode has been selected 
5 by the photographer, the microprocessor 18 makes a decision 
as to whether or not the photographer has intentionally 
selected Che acceptability selection mode (step S42) , When 
the acceptability selection mode has been selected on purpose, 
the photographer will not sense anything amiss even if the 

10 number of fraunes for image -capturing is large. For this reason, 
the microprocessor 18 sets tHe nuziber of frames for image- 
capturing at a relatively large value (10 frames in this 
example) (step S43) . 

In the event that the acceptability selection mode has 

15 been automatically selected (e.g., the microprocessor 18 may 
automatically select the acceptability selection mode in a 
state in which camera vibration tends to occur readily as in 
a macro -photographing mode) , on the other hand, the 
photographer will tend to feel strange if the number of frames 

20 for image -capturing is large. Thus, in such a case, the 
microprocessor 18 sets the number of frames for image - 
capturing at a relatively small value (3 frames in this example) 
(step S44} . It is to be noted that a fixed number of frames 
may be set in advance during the setting operation (step SI) 

25 prior to a shutter release. 
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Next, the microprocessor 18 makes a decision as to 
whether or not the image- capturing operation has been 
performed for the entire number of frames set for image - 
capturing (step S45) - At this point, if the operation has not 
5 been completed for the entire nuinber of frames set for 
image -capturingr, the microprocessor 18 returns to the 
operation in the main routine while holding the stop flag in 
a reset state. If, on the other hand, the operation has 
achieved to capture images for the entire number of frames that 
10 haa been set, the microprocessor 18 decides that the 

image - capturing stop conditions have been met and sets the stop 
flag (step S46) before returning to the operation in the main 
routine . 

In addition, if it is decided in step S41 that a free 
15 photographing mode has been set, the microprocessor 18 makes 
a decision as to whether or not pressure on the shutter release 
button 30 has been released (step S47) . At this point, if the 
shutter release button 30 is still being held down, the 
microprocessor 18 returns to the operation in the main routine 
20 while holding the stop flag in a reset state. 

If , on the other hand, the pressure on the shutter release 
button 30 has been released, the microprocessor 18 decides that 
the image -capturing stop conditions have been satisfied and 
sets the stop flag (step S48> before returning to the operation 
25 in the main routine. 
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If it is deci<aed in step S41 that a stop decision -making 
mode has been set, the microprocessor 18 detects any change 
in the framing based upon the differences in the image data 
among various frames or the like (step S493 . If no change in 
5 the framing is detected, the microprocessor 18 directly 

returns to the operation in the main routine. If, on the other 
hand, a change in the framing is detected, th« microprocessor 
18 decides that the image -capturing stop conditions have been 
satisfied and sets the stop flag (step S48) before returning 

10 to the operation in the main routine. 

Through the series of operations described above, the 
image- capturing stop condition decision -making routine is 
executed, 

(Acceptability evaluation routine) 

15 Next, the acceptability evaluation routine is explained. 

FIG- 7 shows the acceptability evaluation routine executed by 
the microprocessor 18. Initially, when the acceptability 
evaluation routine is started up from the main routine, the 
microprocessor 18 selects one set of image data that has not 

20 he«n evaluated yet and extracts the data included in the image 
data that correspond to an evaluation area (step S6 0) . The 
microprocessor 18 processes the data within the evaluation 
area thus extracted through the following procedure by 
employing the image compression unit 17 (step S61) . 

25 (1) The image compression unit 17 divides the data in the 



evaluation area into 8X8 pixel blocks. 

(2) The image compression -unit 17 executes DCT conversion 
(discrete cosine transformation) for each pixel block. 
C3) The image compression unit 17 performs weighted addition 
5 using the DCT conversion coefficient for each pixel block. 
During this process, by weighting the DCT conversion 
coefficient in the order of the zigzag scan (with greater 
weighting given in proportion to the level of the spatial 
frequency) , evaluation values that indicating the content of 

10 the spatial frequency high frequency component are obtained. 

Then, by performing further weighted addition for the 
evaluation values representing the individual pixel blocks 
thus obtained, an evaluation value for the entire evaluation 
area is calculated (step S62) . It is to be noted that the 

15 evaluation area is divided into three areas, i.e., a peripheral 
portion CI, a middle portion C2 and a central portion C3 , as 
shown in FIG. 5C at this time, with the evaluation weighting 
set greater for pixel blocks closer to the center of the area, 
as indicated in the equations below. 

20 (Evaluation weighting for CI) = 0.3 

(Evaluation weighting for C2) » 0.6 
(Evaluation weighting for C3) = 1.0 

Then, the microprocessor 18 makes a decision as to 
whether or not there are a plurality of evaluation areas (step 
25 S63} , If there is only a single evaluation area, the 
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microprocessor 18 decides that the calculation of the 
evaluation value has been completed, ends the acceptability 
evaluation routine and returns to the operation in the main 
routine. 

5 If, on the Other hand, there are a plurality of evaluation 

areas, the microprocessor IS executes (1) weighted addition, 
(2) majority operation, (3) maximum value operation, (4) 
minimum value operation or the like on the evaluation values 
corresponding to the individual evaluation areas to determine 
10 an integrated evaluation value (step se4) . This sequence of 
processing is implemented for all the image data having 
undergone image - capturing (step S65) - 

(Selection screen display routine) 

The following is an explanation of the selection screen 
15 display routine. FIG. 8 is a flowchart of the selection screen 
display routine executed by the microprocessor 18. First, 
when the image selection display routine is started up from 
the main routine, the microprocessor IS makes a decision with 
regard to the mode setting for screen display (step S71) , 
20 At this point, if the photographing order display mode 

has been selected by the photographer, the microprocessor 18 
brings up a thumbnail display of image data in the order in 
which they were photographed on the display unit 25 via the 
image display circuit 24 (step S72) . If, on the other hand, 
2S the evaluation rank order display mode has been selected by 
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the photographer, the microprocessor 18 brings up a thumbnail 
display of image data in the order of evaluation ranks on the 
display unit 25 via the image display circuit 24 (step S73) . 
The microprocessor 18 brings up a display of frame 
5 numbers and the evaluation ranks overlapping the reduced 

images brought up on thumbnail display via the image display 
circuit 24 (step S74) . FIG. 9A illustrates a selection screen 
displayed in the photographing order display mode. In this 
selection screen, the image data in th« first frame, which are 
10 ranked the highest in the evaluation, include the subject 
photographed rather small due to inappropriate timing of the 
photographing operation . In this situation, the photographer 
may take into consideration both the shutter timing and the 
evaluation ranking to select a good image, e.g. , the image data 
15 in the fourth frame. 

In addition, FIG. 9B presents a selection screen that 
may be displayed in the evaluation rank order display mode. 
In this selection screen, the image data ranked the highest 
in the •valuation have been obtained through inopportune 
20 shutter timing with the subject's eyes partially closed. In 
this situation, the photographer may take into consideration 
both the shutter timing and the evaluation rzmks to make a 
selection of a good image, e.g,, the image data ranked third 
in the evaluation. 
25 In the first embodiment, through the operation explained 
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above, there are advantages as follows. 

(1) Image data with a high content of the high spatial 
freq-uency component can be selected and recorded from image 
data obtained through continuous image- capturing, 

5 Consequently^ image data that contain reduced degrees of 

camera vibration blur, subject-motion blur and poor focus as 
a whole can be selectively obtained. 

(2) Since acceptability evaluation is performed on image 
data within an evaluation area that only partially occupies 

10 the entire image plane, an accurate acceptability evaluation 
of the image data can be achieved while the degree to which 
blurring in the background image and the like affects the 
overall evaluation can be minimized. Furthermore, since the 
acceptability evaluation is not performed on the entire image 

IS plane, the length of time required for the acceptability 
evaluation processing can be reduced. 

(3) Since the evaluation weighting is set lower toward the 
periphery of the evaluation area compared to the evaluation 
weighting set for the central portion of the evaluation area, 

20 the acceptability evaluation value is not caused to fluctuate 
greatly by an image that accidentally jumps into the evaluation 
area. 

(4} Since a plurality of evaluation areas can be evaluated 
in an integrated manner, a correct acceptability evaluation 
25 can be executed even when there are a plurality of subjects 
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present witHin the image plane. 

{S} AH evaluation area can be set by excluding the light areas 
and the <aark areas within the image plane. As a result, it 
is possible to avoid making an inappropriately low evaluation 
5 due to a brightness collapse or the like to execute a correct 
acceptability evaluation by focusing the attention on the 
subject, 

(S) Since a focus -verified area can be set as an evaluation 
area, a correct acceptability evaluation can be executed for 
10 the image of a subject present within the image plane at a 
position corresponding to the focus -verified, area. 

(7) A photometric area or a focal point detection area may 
be set as an evaluation area. Consequently, a setting device 
for the photometric area or the focal point detection area may 

15 be utilized for setting the evaluation area, thereby making 
it possible to further simplify that portion of the structure 
of the electronic camera 10 engaged in setting these areas. 

(8) Since the evaluation area setting can be automatically 
cleared if the photographer fixes the focal adjustment or the 

20 exposure adjustment, any reduction in the reliability of the 
acceptability evaluation which may be caused by a change in 
the image plane composition can be prevented. 

(9) The number of frames for continuous image -capturing can 
toe varied in a flexible manner- during the image -capturing stop 

25 condition decision-making routine. 
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(10) since a continuous image- capturing operation can be 
stopped immedieitely by detecting a change in the framing, 
problems of wastefully sustaining a continuous image - 
capturing operation after a change occurs in the framing and 

5 the lilce can be prevented. 

(11) If none of the evaluations on the image data achieve a 
value equal to or higher than the threshold value, the 
continuous image -capturing operation is resumed. As a result, 
there is no risk of an acceptability selection being executed 

10 on image data with evaluation values lower than the threshold 
value so that storage of image data that achieve a value at 
least equal to or higher than the threshold value is assured. 

(12) The photographer can correctly select and store image 
data obtained in a good photographing state via a selection 

15 screen. During the process of selection, the photographer can 
select image data by referring to the results of the 
acceptability evaluation and also taking into consideration 
subjective criteria such as shutter timing. 

20 (Second Embodiment) 

While acceptability evaluation is performed in a batch 
after taking in a plurality of sets of image data in the first 
embodiment, the electronic camera in the second embodiment 
perfoirms image -capturing and acceptability evaluation on a 

25 single set of image data at a time. It is to be noted that 
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since the structural features of the second embodiment are 
identical to those in the first embodiment (see FIG. 1) except 
for the operating progrzun executed by the microprocessor 18, 
explanation of the structural features is omitted. 
5 (Overview of the Main Routine} 

FI<3. 10 shows the main routine executed by the 
microprocessor 18 when the acceptability selection mode is set. 
The schematic flow of the main routine is explained below before 
the operation is explained in detail. 

10 First, in response to a switching operation at the 

operating switch group 27, the microprocessor 18 sets various 
modes including the photometric mode, the focal point 
detection mode and the acceptability selection mode (step 
SlOO) , Next, the microprocessor 18 executes the evaluation 

15 area routine (step S2) as in the first embodiment. The 

microprocessor 18 repeats these operations until the shutter 
release button 30 is pressed (step SlOl NO) . 

If the shutter release button 20 is pressed by the user 
in this state (step SlOl YSS) , the microprocessor 18 sweeps 

20 out unnecessary electrical charges at the image -capturing 
element 14 via the CCD drive circuit 21 and starts an exposure 
operation for the first frame (step S102) . The microprocessor 
18 waits for the preset exposure period (shutter time) to elapse, 
and then implements control on the CCD drive circuit 21 to read 

25 out image data from the image -capturing element 14 {step 103) . 
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At the point in time at which the image data readout starts, 
an exposure operation of the next frame starts at the 
image -capturing element 14 (step S104) . 

The microprocessor 18 executes the image compression 
5 routine (to be detailed later) for acceptahility evaluation 
and performs acceptability evaluation on the image data for 
which the image -capturing operation has just been completed 
(step S105) . At thi* point, if the change in the acceptability 
evaluation results relative to the previous results indicates 

10 a value equal to or greater than a threshold value, the 

microprocessor 18 decides that a change in the framing has 
occurred (step S106 YES) . Since the picture composition 
itself in the image data changes in sucH a situation, the 
microprocessor 18 decides that acceptability evaluation can 

15 no longer be performed under the same conditions and stops the 
continuous image- capturing operation before returning to the 
operation in step SlOO, 

If, on the other hand, the change in the acceptability 
evaluation results relative to the previous results indicates 

20 a value smaller than the threshold value, the microprocessor 
18 decides that no change in the framing has occurred (step 
S106 NO) . In this situation, the microprocessor 18 continues 
continuous image- capturing by shifting its operation to step 
S107. It is to be noted that it is desirable to set an area 

25 where the image composition changes greatly (e.g., the 
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periphery of the photographic image plane) as a framing change 
detection area- The difference in the image data among 
individual frames, fluctuations in the acceptability 
evaluation results or the like within the detection area can 
be monitored by the microprocessor 18 to promptly detect a 
framing change. 

Next, the microprocessor 18 executes the finder display 
routine (to be detailed later) to display the results of the 
acceptability evaluation at the finder display unit 22 (step 
S107) . At this point, the microprocessor 18 makes a decision 
as to whether or not the results of the acceptability evaluation 
performed on the latest set of image data indicate the highest 
evaluation value thus far (step S108) . If the latest set of 
image data achieves the highest rank in the evaluation (step 
3108 YES) . the microprocessor 18 executes the image overwrite 
recording routine (to be detailed later) to overwrite the 
recorded image on the memory card 20 with the latest set of 
image data (step 109) . If . on the other hand, the latest set 
of image data does not achieve the highest rank in the 
evaluation (Step S108 NO) , the microprocessor 18 does not 
execute any image overwrite recording and, as a result, the 
recorded image on the memory card 20 is not updated. 

Next, the microprocessor 18 makes a decision as to 
whether or not the results of the acceptability evaluation have 
exceeded a relative maximum point (step SllO) . If it is 



decided that the acceptability evaluation results have not 
exceeded the relative maximum point (step SllO NO) , it can be 
decided that the acceptability evaluation on the image data 
is likely to improve further. Thus, the microprocessor 18 
5 returns to the operation in step S10 3 and continuous with the 
continuous image -capturing operation. 

If, on the other hand, the results of the acceptability 
evaluation have clearly exceeded the relative maximum point 
(step S109 YES) , it can be decided that the image data 

10 acceptability evaluation is not likely to improve any further. 
Thus, the microprocessor 18 returns to the operation in step 
SlOO to complete the image - capturing operation in the 
acceptability selection mode for the time being. 

Through the series of operations described above, the 

15 image -capturing operation in the acceptability selection mode 
±s completed. 

Next, details o£ the various sub -routines mentioned 
above are individually explained. 

(Image compression routine for acceptability 
20 evaluation) 

FIG. 11 presents the image compression routine 
implemented for acceptability evaluation. First, when this 
image compression routine is started up from the main routine, 
the microprocessor 18 issues a command to the image compression 
25 unit 17 to perform image compression for acceptability 
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evaluation. In response to this coinman.<J, the image 
compression unit 17 extracts the image data corresponding to 
the evaluation areas included in the latest set of image data. 
The image compression unit 17 compresses the extracted image 
5 data using a compression parameter for acceptability 

evaluation (a scaXe factor or a quantization table with a 
compression ratio of approximately l/lO in this example) (step 
Sill) . 

Next, the microprocessor 18 ascertains the post- 
10 compression code volume o£ the image data having undergone the 
image compression and assigns the code volume as the evaluation 
value for the latest set Of image data (step S112) , After 
obtaining the evaluation value as described above, the 
microprocessor 18 returns to the operation in the main routine. 
15 (Finder display routine) 

FIG. 12 shows the finder display routine- When the 
finder display routine is started up from the main routine, 
the microprocessor 18 makes a decision as to whether or not 
the evaluation value o£ the current set of image data is the 
20 highest evaluation value (step S115) . 

If the evaluation value is ranked the highest in the 
evaluation <step S115 YBS) , the microprocessor 18 uses the 
current evaluation value E to update the highest evaluation 
value £max stored in advance in the internal memory area (step 
25 S116) . If , on the other hand, the current evaluation value 
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is not ranked tlie highest (step S115 NO) , the microprocessor 
18 sustains the highest evaluation value Emax unchanged . Next, 
the microprocessor 18 brings up a bar display of the highest 
evaluation value Baiax and the current evaluation value E at 
5 the finder display unit 22 (step Sil7) , Through the finder 
display routine described above, a display is brought up in 
the finder as illustrated in PIG. 13. 

(Image overwrite recording routine) 

PIG. 14 illustrates the image overwrite recording 
10 routine. First, when the image overwrite recording routine 
is started up from the main routine, the microprocessor 18 makes 
a decision as to whether or not the entire image plane is set 
as the evaluation area (step S12 0) . If it is decided that only 
a portion of the image plane has been set as the evaluation 
15 area (step S120 NO) , the microprocessor 18 shifts its operation 
to step S123 to perform image compression anew for the entire 
image plane. 

If, on the other hand, the entire image plane is set as 
an evaluation area (step S120 YES) , the microprocessor 18 maXes 

2 0 a decision as to whether or not the post- compression code volume 
for the acceptability evaluation is within the allowable range 
for the target post 'compression code volume for recording 
(step S121) . If it is decided in step S121 that the post- 
compression code volume for the acceptability evaluation is 

25 within the allowable range for the target post -compression 
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code volume for recording, it can be decided that it is not 
necessary to perform image compression again. As a result, 
the microprocessor 18 overwrites the memory card 20 by directly 
recording the data that have been compressed for the 
acceptability evaluation (step S122) . Hben this overwrite 
recording is completed, the microprocessor 18 ends the 
overwrite recording routine and returns to the operation izi 
the main routine. 

If, on the other hand, it is decided in step S121 that 
the post -compress ion code volume for the acceptability 
evaluation is not within the allowable range for the target 
post- compression code volume for recording, the 
microprocessor 18 decides that image compression must be 
performed again and shifts its operation to step S123 . In step 
S123, the results of the image compression for the 
acceptability evaluation are regarded as the results of a first 
trial compression, and the compression parameter for recording 
(a scale factor or a quantization tabi« in this example) is 
estimated through a compression parameter estimation method 
in the prior art (e.g. , Japanese Laid Open Patent Publication 
Mo. H4-220879, U.S. Patent No. 5,594,554) or the method 
disclosed in the specification of Japanese Patent Application 
No. H 10-284531 which is not yet known at the time o£ filing 
of this application. 

Next, the microprocessor IS performs image compression 
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again on the current set of image data by using the estimated 
compression parameter (step S124) . The microprocessor IS then 
makes a decision as to whether or not the post-compression code 
volume thus obtained is within the allowable range for the 
5 target post -compression code volume for recording (step S125) . 
At this point, if it is decided that the post -compression code 
volume is not within the allowable range for the target 
compression ratio for recording (step S125 NO) , the 
microprocessor IS re -estimates the compression parameter 

10 (step S126) before returning to the operation in step S124 . 

Tf , on the other hand, the post -compression code volume 
is decided to be within the allowable range for the target 
compression ratio for recording {step S125 YES) , the 
microprocessor 18 overwrites the memory card 20 by recording 

15 the data that have been compressed through this process (step 
S127) . After completing overwrite recording through this 
series of operations, the microprocessor 18 returns to the 
operation in the main routine. 

Through the operations described above, there are 

20 advantages in the second embodiment as follows. 

(1) It is possible to select zuid record image data with a 
high content of the high spatial frequency component among 
image data obtained through continuous image -capturing. Thus, 
image data with lesser degrees of camera vibration blur, 

25 subject -motion blur, poor focus and the like can be obtained 
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with a high degree of reliability, 

(2) In particular, since acceptability evaluation is 
executed concurrently during continuous image- capturing, a 
decision can be made as to whether or not a continuous 

5 image -capturing operation is to be stopped in correspondence 
to the results of the acceptability evaluation. Thus, 
automatic adjustment of the number of frames can be achieved 
with a high degree of accuracy, to efficiently avoid problems 
of the number of frames set too low to result in only images 
10 ranked low in evaluation being captured, the number of frames 
set too high to allow the photographing period to be prolonged 
meaninglessly and the like. 

(3) Since the image compression unit 17 is utilized to 
execute both the image compression for acceptability 

15 evaluation and the image compression for recording. It is not 
necessary to provide a separate processing mechanism fox 
acceptability evaluation, thereby achieving simplification in 
the structure of the electronic camera 10. 

(4) A special compression parameter that is independent of 
20 the compression parameter for recording is used when executing 

the image compression for acceptability evaluation. As a 
result, the image compression can be performed at a compression 
ratio in the medium range, which is suitable for acceptability 
evaluation to achieve an accurate acceptability evaluation. 
25 regardless of the compression ratio set for recording. 
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(5) If the code volume of the compressed data for 
acceptability evaluation is determined to be suitable for 
recording, the compressed data are stored withotit further 
processing. Thus, it becomes possible to omit the re- 
5 compression processing for recording to effectively reduce the 
length of processing tiroe. 

(S) Since the results of compression performed for 
acceptability evaluation are regarded as a trial compression, 
the number of trial compressions that need to be performed 
10 during recording can be reduced with a high degree of 
efficiency. 

(7) Since the results of the acceptability evaluation are 
displayed within the finder, the photographer can refer to the 
finder display to achieve a better photographing state for 

15 subsequent photographing operations. 

(8) Since th« current highest evaluation value and the latest 
evaluation value are displayed on the monitor, the 
photographer is able to achieve a better photographing state 
for subsequent photographing operations by using the highest 

20 evaluation value as a target. 

(Third Embodiment) 

In the third embodiment, a program in a recording medium 
is used to constitute an image selection system on a computer. 
25 FIG. 15 illustrates the configuration of an image selection 
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system achieved by employing a computer 71. 

In FIG. 15, a microprocessor 72 is provided in the 
computer 71. An input device 73 constituted of a keyboard, 
a mouse and the like, a hard disk 74, a memory 75, an image 
5 processing board 7 6 and an interface board 78 are connected 
to the microprocessor 72, A monitor 77 is connected to the 
image output terminal of the image processing board 76. An 
image input device 79 such as a scanner, an electronic camera 
or the like is connected to the interface board 78. 
10 The microprocessor 72 is also connected with a CD ROM 

drive device 80 . A CD ROM 81 having an image processing program 
and an installation program for installing the image 
processing program recorded therein is inserted at the CD ROM 
drive device 80. Using the installation program in the CD ROM 
15 81, tiie microprocessor 72 reads the image processing progrzun 
in the CD ROM 81 and stores it in the hard disk 74 in an 
execution -enabled state. 

{Operation of the third embodiment) 

FIG- 16 shows the main routine in the image processing 
20 program. On the computer 71, a plurality of sets of image data 
are first taken in via the image input apparatus 79 or another 
program and are stored in the hard disk 74 in advance. When 
the image processing program in FIG. 16 is executed in this 
state, the microprocessor 72 executes the evaluation area 
25 setting routine (step S201} , 
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It is to be noted that if the computer 71 is connected 
with an electronic camera or th« like and information 
pertaining to image -capturing (information such as the 
photometric area, the focal point detection area, whether or 
5 not an AE lock is in effect, whether or not an AF lock is in 
effect, the photometric value and the focus- verified area) is 
available, any of the setting routines presented in fig. 3A 
" 3D and FIG, 4 illustrating the first exobodiment can be 
executed. If, on the other hand, such information pertaining 
10 to image -capturing cannot be obtained, evaluation area range 
setting by the user may be accepted via the input device 73, 
such as a mouse. 

In addition, by executing the setting routine presented 
in PIG. 17, an evaluation area can be automatically set. In 
15 FIG. 17, the microprocessor 72 first takes in the brightness 
information in the image data. Based upon the brightness 
information, the microprocessor 72 excludes extremely light 
areas and extremely dark areas in the image plane and creates 
an appropriate exposure area (step S2%0) . Next, the 
20 microprocessor 72 sets this appropriate exposure area as an 
evaluation area (step S211) . After executing one of the 
setting routines described earlier, the microprocessor 72 
executes the acceptability evaluation routine <FIG, 7) 
explained earlier in reference to the first embodiment to 
25 sequentially execute acceptability evaluation on the 
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plurality of sets of image data (step S7) . 

Next, tlie microprocessor 18 makes a decision with, regard 
to the conditions set by the user and determines whether or 
not a good image is to be selected on the screen (step S203) . 
5 At this point, if the user has already selected the operating 
conditions for selecting an image on the screen (step S203 YES) , 
the microprocessor 18 executes the selection screen display 
routine (see FIG. 8) explained earlier in reference to the first 
embodiment and brings up the "thumbnail display of image data 
10 obtained through continuous image-capturing" and the 

"rankings in the acceptability evaluation" overlapping each 
other on the monitor 77 (step SIO) . 

The user manually selects one set of the image data on 
the monitor 77 as a good image by, for instance, operating the 
15 input device 73 (step S205) , After accepting the manual 

selection of the good image, the microprocessor 18 shifts its 
operation to step S207. If. on the other hand, it is decided 
in step S203 that the setting conditions for automatically 
selecting an image have been selected (step S203 NO) , the 
20 microprocessor 18 selects the set of image data ranked first 
in the acceptability evaluation as a good image (step S206) . 

The microprocessor 72 stores the good image selected in 
step S205 or step S206 in this manner on the hard disk 74 (step 
S207) . 

25 Through the series of operations described above, the 
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operation of the image processing program exocuted by the 
computer 71 is completed. 

Through the operations explained above, in the third 
embodiaient, advantages similar to those achieved in the first 
5 and second embodiments are realized on the computer 71. 
(Additional notes on the embodiments) 
It is to be noted that while the spatial frequency 
component undergoes fine evaluation through an orthogonal 
transformation such as DCT conversion in the embodiments 

10 explained above, the present invention is not limited to this 
method. For instance, although the accuracy of acceptability 
evaluation is somewhat lowered, the high band component of the 
spatial frequency may be extracted from the image data within 
an evaluation area via a spatial frecniency filter or the like 

15 of the known art Co perform an acceptability evaluation on the 
image data based upon the quantity of the high band component. 

la addition, while acceptability evaluation is 
performed based upon the spatial frequency component in the 
embodiments explained earlier, the present invention is not 

20 restricted to this method. For instance, although the clarity 
of the evaluation area setting range will be somewhat 
compromised, a camera vibration detection device such as an 
acceleration sensor may be provided at the camera unit to use 
the quantity of camera vibration detected by the camera 

25 vibration detection device for evaluation. 
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Furthermore, acceptability evaluation may be perEormed 
on image data by using the detail component quantity, th« 
contrast quantity, the noiae <5uantity, th.a gradation 
reproducibility, the focus matching degree during image - 
5 capturing, the deg-ree of correctness of exposure, the color 
reproducibility, the degree of saturation and the like in the 
image data as criteria for the evaluation. 

Moreover, while an area corresponding to a photometric 
area or a focal point detection area that is set in advance 

10 is set as an evaluation area in the embodiments explained 
earlier, the present invention is not restricted to this 
example. An evaluation area may be set in advance, instead 
and a photometric area or a focal point detection area may be 
determined in correspondence to the evaluation area. 

15 While the shape and the size o£ an evaluation area and 

those of another type of area are matched in the embodiments 
explained above, the present invention is not restricted to 
this example. Since a satisfactory effect is achieved as long 
as the positions of these areas within the image plane 

20 correspond with each other under normal circumstances, it is 
not particularly essential to match the shapes and sizes of 
the areas as well. 

It is to be noted that while continuous image -capturing 
operation is stopped at a point in time at which an evaluation 

25 value exceeds the relative maxim\nn point (step Slio) in the 
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second embodiment, the present invention is not restricted to 
tliis example. For instance, the continuous image- capturing 
operation may be stopped based upon a decision that a 
sufficiently good image has been captured at a point in time 
5 at which an evaluation va,lue has exceeded a specific upper limit 
value. Alternatively, the continuous image -capturing 
operation may be stopped based upon a decision that further 
continuation of the continuous image- capturing operation is 
meaningless at a point in time at which an evaluation value 

10 has become equal to or less than a specific lower limit value. 
Or, continuous image- capturing may be stopped at a point in 
time at which the number of frames in which images have been 
captured has exceeded a specific value. 

Xn addition, the first embodiment, in which the image 

15 selection is executed after a continuous image -capturing 
operation is completed, achieves an advantage in that a 
continuous image- capturing operation can be performed at high 
speed. The second embodiment, in which image selection and 
overwrite storage are executed on a single image at a time while 

20 a continuous image -capturing operation is in progress, on the 
other hand, achieves an advance in that it is not necessary 
to temporarily store all the image data. Thus, an operation 
switching device may be provided to make a decision as to 
whether or not there is sufficient temporary storage capacity 

25 so that the high speed continuous image -capturing in the first 
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embodiment is executed when there is a comfortable margin in 
terms of temporary storage capacity, whereas the second 
embodiment is adopted if there is no comfortable margin to 
ensure that temporary storage capacity is always available. 
5 Through such an operation of the operation switching device, 
the acc«pt2Lbili ty selection mode can be switched in a flexible 
manner for execution in correspondence to the number of 
remaining frames at the electronic camera and the like. 

Furthermore, while the explanation is given in reference 

10 to the embodiments above on an example in which one set of image 
data among a plurality of sets of image data obtained through 
continuous image- capturing is selected and recorded, it is not 
necessary to limit the number of sets of image data for 
recording to one and two or more sets of image data may be 

15 recorded. 

{Fourtb Embodiment) 

The following is an explanation of the fourth embodiment, 
given in reference to FIGS. 18 and 19. riG. 18 is a block 
20 diagram illustrating the structure of an electronic camera 111 . 
FIG. 19 is an external view of the electronic camera 111 
illustrating the positions of its operating members. 

An image -capturing unit 112 and an electronic flash unit 
113 (a strobe) are provided at the electronic camera 111. The 
25 image- capturing unit 112 and the flash unit 113 are both 
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provided with a control signal by a microprocessor 114 in the 
electronic camera 111. An image signal output from the 
image- capturing unit 112 is input to the microprocessor 114 
via an image processing unit 115 where it undergoes gamma 
5 correction and A/D conversion. The microprocessor 114 is 
connected with an image memory 117, an image compression unit 
118, a card interface 119 and the like via a system bug 116, 
and a display unit 125 directly. 

At the upper surface of the casing of the electronic 
10 camera 111, operating members such as a shutter release button 
122, a command dial 123 and a selector button group 124 are 
provided. Switch signals from these operating members are 
taken into the microprocessor 114. 

(Operation of the fourth embodiment) 
15 The following is an explanation of the operation 

performed in the fourth embodiment. 

FIG. 20 is a flowchart of the operation performed by the 
microprocessor 114. First, the microprocessor 114 takes in 
an external mode selection operation performed by the 
20 photographer via the selector button group 124 and the command 
dial 123 . The external operation performed at this point may 
be one of the following (Dl) - (D3) below, for instance. 
(Dl) Setting / clearing the acceptability selection mode: 
The photographer selectively presses an acceptability 
25 selection button I24a in the selector button group 124. He 
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turns the command dial 123 in this state to alternately set 
/ clear the acceptability selection mode. 

(D2) Setting / clearing of the continuous shooting mode: 

The photographer selectively presses an S/C button 124t) 
5 in the selector button group 124. He turns the command dial 
123 in this state to alternately set / clear the continuous 
shooting mode. 

(D3) Setting / clearing of the light emission mode: 

The photographer selects and presses a flash mark button 
10 124c in the selector button group 124. He turns the command 
dial 123 in this state to alteraately set / clear the light 
emission mode. 

In response to such an external operation, the 
microprocessor 114 changes the mode setting at the electronic 
15 camera 111 (FIG, 20 S300) , 

FIG. 21 is a state transition diagram illustrating in 
detail the mode setting changes effected through this process. 
As illustrated in FIG. 21. there are 8 different types of mode 
states PI " P8 listed below depending upon how the three types 
20 of modes (light emission mode, continuous shooting mode, 
acceptzdaility selection mode) are combined. 

PI normal mode (non- light emission mode and single shot mode 
and non- acceptability selection mode) 
P2 light emission mode 
25 P3 continuous shooting mode 
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P4 acceptability selection mode 

P5 light . emission mode, continiious shooting mocle 
p6 acceptability selection mode, light emission mode, 
continuous shooting mode 
5 P7 acceptability selection mode, light emission mode 
PSacceptability selection mode, continuous shooting mode 

In the mode states PI ~ P4 , no problems attributable to 
a plurality of modes used at the same time occur. Thus, the 
microprocessor 114 directly accepts an external mode selection 

10 operation performed by the photographer to change the mode 
within the range of the states PI ~ P4 and executes a mode 
setting change (the state transitions marked with circles in 
FIG. 21) . At this point, tlie microprocessor 114 notifies the 
photographer that a mode setting change has been executed 

IS through mode display on the display unit 25. 

In the other mode states P5 - P8, on the other hand, at 
least two modes among the three types of modes (the light 
emission mode, the continuous shooting mode, the acceptability 
selection mode} may be set concurrently and problems 

20 attributable to using a plurality of modes at the same time 
are expected to occur. In order to prevent these problems, 
the microprocessor 114 does not accept any external mode 
selection operation that would cause a transition to any of 
the states P5 - P8 (the state transitions marked with crosses 

25 in FIG. 21) . At this time, the microprocessor 114 issues a 
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warning indicating that the mode change is not accepted via 
the display unit 125 , a buzzer or the like . The microprocessor 
114 repeatedly executes the series of setting operations 
described above until the shutter release button 122 is pressed 
5 (FIG. 20, S3 01 NO) , 

If the shutter release button 122 is pressed in such a 
state CFIG. 20, S301 YES) , the microprocessor 114 selects the 
photographing sequence that corresponds to the current mode 
setting (FIG. 20, S3 02) , In conformance to the photographing 

10 sequence thus selected, the microprocessor 114 implements 
control on the image- capturing unit 112 or the flash unit 113 
to perform photographing. 

In other words, in the normal mode, the microprocessor 
114 implements control on the image- capturing, unit 112 to 

15 perform photographing for one frame <riG. 20, S303) . In the 
light emission mode, the microprocessor 114 implements control 
on Che flash unit 113 and the image -capturing unit 112 to 
perform flash photographing for one frame (FIG. 20, S304) . In 
the continuous shooting mode, the microprocessor 114 

20 implements control on the image- capturing unit 112 to perform 
a continuous shooting operation (PIG. 20, S305) . 

In addition, if the acceptability selection mode has been 
set, the microprocessor 114 first implements control on the 
image- capturing unit 112 to photograph images corresponding 

25 to a plurality of frames (FIG. 20, S306) . Next, the 
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microprocessor 114 performs acceptability evaluation in 
regard to tlxe photographing states of the individual images. 
In this example, an image with a greater post- compression code 
volume is evaluated as a good image {FIG- 20, S3 07) . The 
5 microprocessor 114 records only the good image rated high in 
the evaluation at a memory card 121 via the card interface 119 
(PIG. 20, S308} . 

After completing the photographing seciuence 
corresponding to each mode once as described above, the 
10 microprocessor 114 returns to the operation in step S300. 

Through the operations described above, image data 
obtained in a good photographing state are selected from image 
data obtained through continuous image -capturing and are 
recorded in the acceptability selection mode in the fourth 
15 embodiment. Thus, image data achieved through a good 

photographing state can be obtained without having to employ 
any type of camera vibration correction mechanism of the prior 
art. 

In addition, in the fourth embodiment, the acceptability 
20 selection mode, the continuous shooting mode and the light 
emission mode are prevented from being set in combination with 
a high degree of reliability. Consequently, any problems 
attributable to using these modes together can be prevented. 
In particular, any external operation that would cause 
25 problems is not accepted at the point in time at which the 
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external operation is attempted by the photographer. This 
prompts awareness on the part of the photographer that these 
modes cannot be used together. 



s (Fifth Embodiment) 

Since the structure and the photographing sequences of 
the fifth embodiment are identical to those of the fourth 
embodiment {see FIG. 18 and FIG. 20), their explanation is 
otaitted. 

10 FIG- 22 is a state transition diagram illustrating mode 

setting changes effected by the microprocessor 114. It is to 
be noted that the illustration of the state transitions 
occurring between the continuous shooting mode and the light 
emission mode are omitted in PIG. 22 to simplify the explanation 

15 of the invention. As illustrated in FIG. 22. flags Fl - F3 
for storing the mode history are provided in advance on the 
internal memory of the microprocessor 114. When one of the 
flags Fl - P3 is set, it indicates the following mode history. 
Fl : The continuous shooting mode has been previously cleared 

2 0 automatically 

F2i The light emission mode has been previously cleared 
automatically 

F3: The acceptability selection mode has been previously 
cleared automatically 
25 The following is an explanation of specific mode setting 



change operations performed in specific situations {ED - 
(E8) . 

(El: The normal mode is set) 

WTiea the main power is turned on at Che electronic camera 
5 111, the microprocessor 114 selects the normal mode as an 
initial state. It is to be noted that the normal mode 
corresponds to a state in which the non- light emission mode, 
the single shot mode and the non - acceptability selection mode 
are set. 

10 In the state in which the normal mode is selected, the 

microprocessor 114 resets the flags Fl - P3 to erase the past 
mode history. If the photographer performs a setting 
operation to select any one Of the light emission mode, the 
continuous shooting mode and the acceptability selection mode 

15 while the noirmal mode is set, the microprocessor 114 effects 
a setting change to shift to the desired mode. 

(E2: In a state in which the acceptability selection mode 
is set, an external operation is performed to select the 
continuous shooting mode) 

20 If the photographer performs a setting operation to 

select the continuous shooting mode while the acceptability 
selection mode is set, the microprocessor 114 automatically 
clears the acceptability selection mode that is currently 
selected and then effects a setting change to select the 

25 continuous shooting mode. Concurrently with such a setting 
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change, tlie microprocessor 114 sets the flag F3 and stores the 
"automatic clearing of the acceptability selection mode. " In 
addition, the microprocessor 114 resets the other flags Fl and 
F2 to erase other unnecessary mode histories- 

{E3 : In a state in which the acceptability selection mode 
is set, an external operation is performed to select the light 
emission mode) 

If the photographer perforins a setting operation to 
select the light emission mode while the acceptability 
selection mode is set. the microprocessor 114 automatically 
clears the acceptability selection mode that is currently 
selected and then effects a setting change to select the light 
emission mode. Concurrently with snch a setting change, the 
microprocessor 114 sets the flag P3 and stores the "automatic 
clearing of tHe acceptability selection mode." In addition, 
the microprocessor 114 resets the other flags Fl and P2 CO erase 
other unnecessary mode histories , 

(E4 : In a state in which the acceptability selection mode 
is set, an operation is performed to clear the acceptability 
selection mode) 

If the photographer performs an operation to clear the 
acceptability selection mode while the acceptability 
selection mode is set. the microprocessor 114 makes a decision 
with regard to the states of the flags PI and F2 . At this point, 
if the flags Fl and F2 are both determined to toe in a reset 



state, tlie microprocessor 114 clears the acceptability 
selection mode and effects a setting change to select the normal 
mode , 

If, on the other hand, the flag Fl is determined to be 
5 in a set state, the microprocessor 114 clears the acceptability 
selection mode and resets the flag Fl before effecting a setting 
change (recovery) to select the continuous shooting mode . If 
the flag F2 is determined to be in a set state, the 
microprocessor 114 clear* the acceptability selection mode and 

10 resets the flag F2 before effecting a setting change (recovery) 
to select the light emission mode. 

(E5i In a state in which the continuous shooting mode 
is set, a setting operation is performed to select the 
acceptability selection mode) 

15 If the photographer performs a setting operation to 

select the acceptability selection mode while the continuous 
shooting mode is set, the microprocessor 114 automatically 
clears the continuous shooting mode that is currently selected 
and then effects a setting change to select the acceptability 

20 selection mode. Concurrently with such a setting change, the 
microprocessor 114 sets the flag Fl to store the "automatic 
clearing of the continuous shooting mode." In addition, the 
microprocessor 114 resets the other flags F2 and F3 to erase 
other unnecessary mode histories. 

25 (E$: In a state in which the continuous shooting mode 
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is setj an operation is performed to clear the continuous 
shooting mode) 

If the photographer performs an operation to clear the 
continuous shooting mode while the continuous shooting mode 
5 is set, the microprocessor 114 makes a decision with regard 
to the state of the flag F3 . At this point, if the flag F3 
is determined to be in a reset state, the microprocessor 114 
Clears the continuous shooting mode and effects a setting 
change to select the normal mode. If, on th« other hand, the 

10 flag F3 is determined to be in a set state, the microprocessor 
114 clears the continuous shooting mode and resets the flag 
PS before effecting a setting change (recovery) to select the 
acceptability selection mode. 

{E7 : In a State in -vrhich the light emission mode is set, 

15 a setting operation is performed to select the acceptability 
selection mode) 

If the photographer performs a setting operation to 
select the acceptability selection mode while the light 
emission mode is set, the microprocessor 114 automatically 

20 clears the light emission mode that is currently selected and 
then effects a setting change to select the acceptability 
selection mode. Concurrently with such a setting change, the 
microprocessor 114 sets the flag F2 to store the "automatic 
clearing of the light emission mode." In addition, the 

25 microprocessor 114 resets the other flags Fl and P3 to erase 
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other unnecessary mode histories. 

(E8: In a State in which the light emission mode is set, 
an operation is performed to clear the light emission mode) 
If the photographer performs an operation to clear the 
5 light emission mode while the light emission mode is set, the 
microprocessor 114 makes a decision with regard to the state 
of the flag F3- At this point, if the flag F3 is determined 
to be in a reset state, the microprocessor 114 clears the light 
emission mode and effects a setting change to select the normal 

10 mode. If, on the other hand, the flag P3 is determined to be 
in a set state, the microprocessor 114 clears the light emission 
mode and resets the flag F3 before effecting a setting change 
(recovery) to select the acceptability selection mod«. 
la the fifth embodiment, too, by performing the 

15 operations described above, the acceptability selection mode, 
the continuous shooting mode and the light emission mode can 
be prevented from being used at the same time with a high degree 
of reliability. Thus, any problems attributable to these 
modes being set concurrently can be prevented. 

20 In particular, in the fifth etftbodiment, priority ia given 

to a mode to be set anew and the mode that has been previously 
set is automatically cleared. Thus, the most recent 
photographing intention of the photographer can be reflected 
in the mode setting of the electronic camera 111 with a high 

25 degree of accuracy. In addition, it is not necessary for the 
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photographer to go to the trouble of clearing the unwanted mode 
set previously in this situation. As a result, the operability 
in mode setting is further improved. 

Furthermore, in the fifth embodiment, when problems 
attributable to using a plurality of modes at the same time 
are eliminated in response to a photographer operation, the 
previous mode is automatically restored. Thus, it is not 
necessary for the photographer to consciously reverse the 
automatic clearing of the mode that has been unilaterally 
effected by the electronic camera 111, thereby achieving a 
further improvement in the operability in mode setting. 

(Sixth Embodiment) 
Sine* the structure of the sixth embodiment is identical 
to that adopted in the fourth embodiment (see FIG. la) except 
for the internal program at the microprocessor 114, the 
explanation of its structural features is omitted. 

riG. 23 is a flowchart of the operation performed by the 
microprocessor 114. The following is an explanation of the 
operation performed in the sixth embodiment given in reference 
to FIG. 23. The microprocessor 114 first obtains the switch 
states of the selector button group 124 and the command dial 
123, and directly proceeds to execute mode setting / clearing 
(FIG. 23, S400) . It is to be noted that unlike in the fourth 
and fifth embodiments explained earlier, multiple mode setting 



86 



is not specially avoided in the sixth, embodiment. 

The microprocessor 114 repeatedly executes the mode 
setting / clearing until the shutter release button 122 is 
pressed (FIG. 23, S401 NO) . If the shutter release button 122 
5 is pressed during such repeated operation (FIG. 23. S401 YES) , 
the microprocessor 114 first makes a decision as to whether 
or not the continuous shooting mode is currently set (FIG. 23, 
S402) . If it is decided that the continuous shooting mode is 
currently set, the microprocessor 114 executes a continuous 

10 shooting operation regardless of any other operating modes 
that may be set (FIG. 23, S403) . 

If. on the other hand, the single shot mode is currently 
set, the microprocessor 114 makes a decision as to whether or 
not the light emission mode is currently set (FIG. 23, S404> . 

IS If it is decided that the light emission mode is currently set, 
the microprocessor 114 executes a flash photographing 
operation regardless of any other operating modes that may be 
set (PIG. 23, S405) . 

If, on the other hand, the non- light emission mode is 

20 currently set, the microprocessor 114 makes a decision as to 
whether or not the acceptability selection mode is currently 
set (FIG. 23, S406) . If it is decided that the non- 
acceptability selection mode is currently set, the 
microprocessor 114 executes a photographing operation in the 

25 normal mode (FIG. 23, S407) . If the acceptability selection 
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mode is currently set, the microprocessor 114 executes a 
photographing operation in the acceptability selection mode 
{FIG. 23, S4 08 - S410) . After completing the photographing 
sequence corresponding to a given mode as described above once. 
5 the microprocessor 114 returns to the operation in step S400. 
Through the operations described above, the 
microprocessor 114 gives priority to the photographing 
sequence in the continuous shooting mode (FIG. 23, S4Q3) for 
execution if the continuous shooting mode and another mode are 

10 set concurrently in the sixth embodiment. In addition, the 
microprocessor 114 gives priority to the photographing 
seoruence in the light emission (FIG. 23, S40S) for execution 
if the light emission mode and the acceptability selection mode 
are set concurrently in the sixth embodiment. 

15 ConseJiuently , concurrent use of a plurality of modes can 

be avoided with a high degree of reliability in the sixth 
embodiment in which the modes can be set at the same time . Thus , 
any problems attributable to using these modes at the same time 
can be prevented. 

20 It is to be noted that in the fourth through sixth 

embodiments described above, a good image is selected based 
upon the post-compression code volume in the acceptability 
selection mode. However, the operation that may be performed 
in the acceptability selection mode according to the present 

25 invention is not restricted to this example. Generally 
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speaking, any operation in which acceptability evaluation is 
performed on the photographing states of images and through 
■which a good image is selected based upon the acceptability 
evaluation will achieve the advantages of the present 
5 invention. 

For instance, as described in detail in the specification 
of Japanese Patent Application No.HlO-236l02. an image with 
the least amount of blur can be selected as a good image by 
detecting the quantities of camera vibration occurring at the 

10 electronic camera during photographing with an acceleration 
sensor or the like. In addition, in the acceptability 
selection mode according to the present invention, 
acceptability evaluation does not need to be performed by using 
a single criterion and acceptability evaluation may be 

15 executed by using a plurality of criteria to achieve an 
integrated acceptability evaluation based upon these 
criteria. 

In addition, while the explanation is given in reference 
to the first and second embodiments and the fourth through sixth 

2 0 embodiments on an example in which the system is constituted 
of a single unit electronic camera, the present invention is 
not restricted to this structure. For instance, the 
electronic camera in any of these embodiments may be 
constituted as a system comprising separate units such as an 

25 image -capturing unit and an information processing unit 
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(including a computer, a palm- size electronic notepad and the 
like) . In such a case, a program for executing the flow of 
the operation in each of the embodiments may be provided on 
a recording medium such as a CD ROM so that the program can 
5 be installed at the information processing unit for execution. 
The recording medium may be constituted by using any of various 
types of recording media including a memory card, a floppy disk, 
a magnetic tape and a DVD. It goes without saying that the 
program may instead be stored in advance in the ROM or the hard 

10 disk of the information processing unit. 

Alternatively, the program may be provided via a 
communication medium such as a transmission line, a typical 
example of which is the internet. Namely, the programs may 
be converted to signals on a carrier wave that is transmitted 

15 on a transmission medium, and transmitted. 

FIG. 24 illustrates a configuration through which the 
program is provided in this manner. An electronic camera 2 01 
is constituted of separate units, i.e., an image -capturing 
unit 202 and an information processing unit 203. as described 

20 above. The information processing unit 203, which is provided 
with a CD ROM drive device, is capable of receiving programs 
provided on a CD ROM. In addition, the information processing 
unit 203, which has a function of connecting with a 
telecommunication line 205, is capabl* of receiving programs 

25 provided via the internet or the like. The programs described 
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above are stored in a computer 206, which functions as a server 
computer, i.e., the provider of the program. The 
telecommunication line 2 05 may toe a telecommunication line fox 
an internet connection, telecomputing service or the like or 
5 a dedicated telecommunication line. The telecommunication 
line 205 may be a telephone line, a wireless telephone line, 
a mobile telephone line or the like. In addition, the program 
executed by the computer 71 in FIG. IS illustrating the third 
embodiment, too, may be provided through the internet or the 
10 like. 

It is to be noted that in the electronic camera adopting 
the single, integrated -unit structure in the first embodiment, 
the control program according to the present invention 
executed in the electronic camera are normally installed in 

15 a ROM or the like during the production stage. However, the 
ROM in which the control program i» installed may be a writable 
ROM which is connected to a computer by adopting a structure 
similar to that illustrated in FIG. 15 so that program revisions 
can be provided from a recording medium such as a CD ROM via 

20 the computer, in addition, a revised program may be provided 
via the internet or the like as described above. 
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What is claimed is; 

1 . An image processing apparatus having an image selecting 
£unctioii, comprising: 

an evaluation device that takes in a plurality of sets 
5 of image data of a subject obtained through image -capturing 
and performs acceptability evaluation on each of said 
plurality of sets of image data; and 

an acceptability selection device that selects image 
data ranked high in the acceptability evaluation among the 
XO plurality of sete of image data having undergone the 

acceptability evaluation performed at said evaluation device. 

2. An image processing apparatus according to claim 1, 
wherein said plurality of aets Of image data are obtained 

15 through continuous image- capturing at predetermined time 
intervals . 

3. An image processing apparatus according to claim 1, 
wherein said acceptability selection devic« records the 

20 selected image data into a recording medium. 

4. An image processing apparatus having an image selecting 
function, comprising: 

an evaluation device that takes in a plurality of sets 
25 of image data obtained through continuous image -capturing and 
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performs acceptability evaluation on each of the plurality of 
sets of image data within an evaluation area set to occupy a 
portion of an image plane; and 

an acceptability selection device that selects image 
5 data ranked high in the acceptability evaluation among the 
plurality of sets of image data having undergone the 
acceptability evaluation performed at said evaluation device 
and records the image data into a recording medium. 

5. An image processing apparatus according to claim 4, 
wherein : 

said evaluation device sets evaluation weighting toward 
a peripheiry of the evaluation area lower than an evaluation 
weighting at a central portion of the evaluation area. 

6. An image processing apparatus according to claim 4, 
wherein: 

a plurality of evaluation areas are set at a plurality 
of locations within the image plane; and 

said evaluation device performs integrated evaluation 
of acceptability of image data based upon individual 
evaluations performed in the evaluation areas . 

7. An image processing apparatus according to claim 4, 
25 further comprising: 
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an area setting device that selects an evaluation area 
or selects and changes weighting of evaluation areas. 

8. An image processing apparatus according to claim 7, 
5 wherein: 

said area setting device selects an evaluation area by 
excluding light areas and dark areas in the image plane or by 
setting evaluation weighting for light areas and dark areas 
at a relatively low level- 

10 

9. An image processing apparatus according to claim 7, 
wherein; 

said area setting device selects an evaluation area by 
selecting an area that is in a focus -verified state in the image 
15 plane or by setting evaluation weighting for the area that is 
in a focus -verified state at a relatively high level, 

10. An image processing apparatus according to claim 7, 
further comprising: 

20 am image- capturing device that continuously captures 

images of a subject, wherein: 

said area setting device is also utilized to select a 
photometric area for said image- capturing device, and in 
correspondence to either the photometric area or the 

25 evaluation area that is determined first, the other area is 
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determined. 



11. An image processing apparatus according to claim 7, 
further comprising: 

S an image -capturing device that continuously captures 

images of a subject, wherein: 

said area setting device is also utilized to select a 
focal point detection area for said image -capturing device, 
and in correspondence to either the focal point detection area 
10 or the evaluation area that is determined first, the other area 
is determined. 

12. An image processing apparatus according to claim 10, 
further comprising: 

15 a lock device that fixes exposure adjustment in response 

to an external operation, wherein i 

said area setting device clears or re- sets the evaluation 
area when said lock device has fixed the exposure adjustment. 

20 13, An image processing apparatus according to claim 11, 
further comprising: 

a lock device that fixes fecal adjustment in response 
to an external operation, wherein: 

said area setting device clears or re -sets the evaluation 
2S area when said lock device has fixed the focal adjustment. 
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3.4. An image processing apparat:us having an. image selecting 
function, comprising: 

an image -capturing device that continuously captures 
5 images of a subject; 

an evaluation device that takes in a plurality of sets 
of image data obtained at said image -capturing device through 
continuous image - capturing and performs acceptai>ilicy 
evaluation on each of the plurality of sets of image data; 

10 an acceptability selection device that selects image 

data ranked high in the acceptability evaluation among the 
plurality of sets of image data having undergone the 
acceptability evaluation performed at said evaluation device 
and records the itnage data into a recording medium; and 

15 a frame number changing device that changes a number of 

frantes over which continuous image- capturing is performed at 
said image -capturing device. 

15. " An image processing apparatus according to claim 14. 
20 wherein: 

said frame number changing device stops a continuous 
image -capturing operation performed by said image 'Capturing 
device when an evaluation made by said evaluation device 
indicates one of a value greater than a specific upper limit 
25 value, a value less than a specific lower limit value and a 
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relative maximunft value. 

16. An image processing apparatus according to claim 14, 
further compri s ing : 

5 a framing detection device that detects a framing change 

at said image -capturing device, wherein; 

said frame number changing device stops a continuous 
image -capturing operation by said image- capturing device when 
the framing change is detected by said framing detection 
10 device. 

17. An image processing apparatus according to claim 14, 
wherein: 

said frame number changing device allows a continuous 
15 image -capturing operation to be resumed at said image - 
capturing device when none of evaluations made by said 
evaluation device reach a specific threshold value. 

18. An image processing apparatus having an evaluation 
20 display function, comprising: 

an evaluation device that takes in a plurality of sets 
of image data obtained through continuous image -capturing and 
performs acceptability evaluation on each of the plurality of 
sets of image data; 
25 a display device that displays image data together with 
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evaluations of the linage data made by ^aid evaluation device; 

a selection operation device that accepts an external 
image selection operation that is performed to aeslect one set 
of image data among the image data brought up on said display 
5 device; and 

a selection recording device that records the image data 
selected via said selection operation device into a recording 
medlTim. 

10 19. An image processing apparatus having an evaluation 
display function, comprising: 

an evaluation device that takes in a plurality of sets 
of image data obtained through continuous image -capturing and 
performs acceptability evaluation on each of the plurality of 
15 sets of image data; 

a display device that displays a plurality of sets of 
image data in & order of evaluation rankings in the 
acceptability evaluation made by said evaluation device; 

a selection operation device that accepts an external 
20 image selection operation that is performed to select one set 
of image data among the image data brought up on said display 
device; and 

a selection recording device that records the image data 
selected via said selection operation device into a recording 
25 medium. 
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2D. An image processing apparatus having an evaluation 
display function, comprising: 

an evaluation device that performs acceptability 
5 evaluation on image data obtained through, image- capturing; and 
a display device that displays an image based upon the 
image data together with the evaluation made by said evaluation 
device. 



XO 21. An image processing apparatus according to claim 20, 
wherein : 

said display device displays a highest evaluation made 
by said evaluation device together with a most rec«nt 
evaluation made by said evaluation device. 

15 

22. An image processing apparatus having an image selecting 
function, comprising; 

a compression device that engages in compression 
processing on image data; 

20 an evaluation device that controls said compression 

device to compresses a plurality of sets of image data obtained 
through continuous image- capturing by usin^f a compression 
parameter for acceptability evaluation and performs 
acceptability evaluation on each set of image data based upon 

25 a resulting post- compression code volume; and 



99 



an acceptability selection device that selects image 
data ranked high in the acceptability evaluation among the 
plurality of sets of image data having undergone the 
acceptability evaluation at said acceptability evaluation 
device and records the selected image data into a recording 
medium in a state in which the selected image data are 
cojnpressed via said compression device to achieve a target 
post -compression code volume for image recording, 

23. An image processing apparatus according to claim 22. 
wherein; 

said acceptability selection device makes a decision as 
to whether or not a post- compression code volume of the image 
data that have been selected, achieved in the acceptability 
evaluation is within an allowable range for a target poat- 
compression code volume for image recording, and records 
compressed data resulting from the acceptability evaluation 
if the post -compress ion code volume is within the allowable 
range, but re-compresses the image data that have been selected 
to achieve the target post -compress ion volume for image 
recording and records the re- compressed image data if the 
post -compression code volume is not within the allowable 
range . 

24. An image processing apparatus according to claim 22, 
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wherein : 

said compression device determines a compression 
parameter to be used for re -compression to achieve the target 
post -compression volume for image recording based upon results 
5 of the compression processing performed during the 
acceptability evaluation. 

25. An image processing apparatus comprising: 

an image- capturing device that captures an image of a 
10 subject; 

a recording device that records image data obtained 
through image -capturing performed by said image -capturing 
device; 

a photographic evaluation device that evaluates 
15 acceptability of a photographing state in which the image data 
have been obtained through image -capturing performed by said 
image -capturing device; 

a mode setting device that, in response to an external 
operation, seta or clears (1) an acceptability selection mode 
20 in which image data with a high evaluation from said 

photographic evaluation device among image data obtained 
through continuous image- capturing performed by said 
image- capturing device are selectively recorded and (2) a 
continuous shooting mode in which image data corresponding to 
25 a plurality of frames obtained through continuous image- 
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capturing performed by said image- capturing device are all 
recorded, to determine a photographing secjuence that 
corresponds to a current mode setting; and 

a photographic control device that implements control 
5 on said image- capturing device and said recording device in 
confoimance to the photographing sequence determined by said 
mode setting device and executes photographing, wherein: 

said mode setting device implements control of setting 
to ensure that even if an instruction is issued through an 
10 external operation for a setting whereby the acceptability 
selection mode and the continuous shooting ntode overlap each 
other the acceptability selection mode and the continuous 
shooting mode do not overlap in setting. 

15 26. An image processing apparatus according to claim 25, 
wherein: 

said mode setting device implements control to ensure 
that i£ an external operation is performed to set either the 
continuous shooting mode or the acceptability selection mode 
20 while the other mode Is set, the external operation is not 
accepted. 

27. An image processing apparatus according to claim 25, 
wherein: 

25 said mode setting device implements control to ensure 
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that if the continuous shooting mode and the acceptability 
selection mode are set overlapping each other, either mode that 
has been set earlier is automatically cleared, 

5 28. An image processing apparatus according to claim 27, 
wherein: 

said mode setting device reverts to the mode set earlier 
and automatically cleared, if an external operation clears 
over lapping of mode settings. 

10 

29- An image processing apparatus comprising: 

an image - capturing device that captures an image of a 
subject; 

a recording device that records image data obtained 
15 through image -capturing performed by said image- capturing 
device; 

a photographic evaluation device that evaluates 
acceptability o£ a photographing state in which the image data 
have been obtained through image- capturing performed by said 
20 image -capturing device; 

a mode setting device that, in response to an external 
operation, s«ts or clears (1} an acceptability selection mode 
in which image data with a high evaluation from said 
photographic evaluation device among image data obtained 
25 through continuous image -capturing performed by said 
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image- capturing device are selectively recorded and (2) a 
continuous shooting mode in which image data corresponding to 
a plurality of frames obtained through continuous image- 
capturing performed by said image- capturing device are all 
5 recorded, to determine a photographing sequence that 
correspond* to a current mode setting; and 

a photographic control device that implements control 
on said image -capturing device and said recording device in 
conformance to the photographing sequence determined by said 

10 mode setting device and executes photographing, wherein: 
said photographic control device executes a 
photographing sequence selected in correspondence to a mode 
given higher priority in conformance to a predetermined 
priority order even if the acceptability selection mode and 

15 the continuous shooting mode are set overlapping each other 
througli an external operation . 

30. An image processing apparatus comprising: 

an image - capturing device that captures an image of a 
20 subject; 

a recording device that records image data obtained 
through image ' capturing performed by said image -capturing 
device; 

a photographic evaluation device that evaluates 
25 acceptability of a photographing state in which the image data 
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have been obtained through image- capturing performed by said 
image- capturing device; 

a mode setting device that^ in response to an external 
operation, sets or clears (1) an acceptability selection mode 
5 in which image data with a high evaluation from said 

photographic evaluation device among image data obtained 
through continuous image -capturing performed by said 
image- capturing device are selectively recorded and (2) a 
light emission mode in which light"~em"irs'sion is performed 

10 automatically or unconditionally by controlling an external 
or internal flash unit at image -capturing by said image - 
capturing device, to determine a photographing sequence that 
corresponds to a current mode setting; and 

a photographic control device that implement* control 

15 on said image -capturing device and said recording device in 
conformance to the photographing sequence determined by said 
mode setting device and executes photographing, wherein: 

said mode setting device Implements control of setting 
to ensure that even if an instruction is Issued through an 

20 external operation for a setting whereby th« acceptability 
selection mode and the light emission mode overlap each other 
the acceptability selection mode and the continuous shooting 
mode do not overlap in setting. 

25 31. An image processing apparatus according to claim 30, 
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wherein: 

said mode setting device iinpleiadnts control to ens-ure 
that if an external operation is performed to set either the 
light emission mode or the acceptability selection mode while 
5 the other mode is set, the external operation is not accepted. 

32. Ad. image processing apparatus according to claim 30, 
wherein: 

said mode setting device implements control to ensure 
10 that if the light emission mode and the acceptability selection 
mode are set overlapping each other, either mode that has been 
set earlier is automatically cleared. 

33. An image processing apparatus according to claim 32, 
15 wherein : 

said mode setting device reverts to the mode set earlier 
and automatically cleared, if an external operation clears 
overlapping of mode settings . 

20 34. An image processing apparatus comprising: 

an image -capturing device that captures an image of a 
subject; 

a recording device that records image data obtained 
through image- capturing performed by said image -capturing 
25 device; 
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a photographic evaluation device that evaluates 
acceptability of a photographing state in which the image data 
have been obtained through image -capturing perforroed. by said 
image -capturing device; 
5 a mode setting device that, in response to a» external 

operation, sets or clears (1) an acceptability selection mode 
in which image data with a high evaluation from said 
photographic evaluation device among image data obtained 
through continuous image -capturing performed by said 

10 image -capturing device are selectively recorded and <2) a 
light emission mode in which light emission is performed 
automatically or unconditionally by controlling an external 
or internal flash unit at image -capturing by said image- 
capturing device, to determine a photographing sequence that 

15 corresponds to a current, mode setting; and 

a photographic control device tbat implements control 
on said image -capturing device and said recorCing device in 
conformance to the photographing sequence determined by said 
mode setting device and executes photographing, wherein: 

20 said photographic control device executes a 

photographing sequence selected in correspondence to a mode 
given higher priority in conformance to a predetermined 
priority order even if the acceptability selection mode and 
the light emission mode are set overlapping each other through 

25 an external operation. 
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35- A recording medium having a control program to be 
utilized at an image processing apparatus having an image 
selecting function recorded therein, said control program 
5 comprising: 

an instruction for taking in a plurality of sets of image 
data o£ a subject obtained through image -capturing ; 

an instruction for performing acc«ptability evaluation 
on each of the plurality of sets of image data; and 
10 an instruction for selecting image data ranked high in 

the acceptability evaluation among the image data having 
undergone the acceptability evaluation. 



36. A data signal embodied in a carrier wave comprising a 
15 control program for use by an image processing apparatus having 
an Image selecting function, said control program comprising: 

an instruction for taking in a plurality of sets of image 
data of a subject obtained through image -capturing; 

an- instruction for performing acceptability evaluation 
20 on each of the plurality of sets of image data; and 

an instruction for selecting image data ranked high in 
the acceptability evaluation among the image data having 
undergone the acceptability evaluation. 
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ABSTRACT OP THE DISCLOSURE 



An image processing apparatus having an image selecting 
function, includes: aa evaluation device tliat takes in a 
5 plurality of sets of image data of a subject obtained through 
image - capturing and performs acceptability evaluation on each 
Of the plurality of sets of image data; and an acceptability 
selection device that selects image data ranked high in the 
acceptability evaluation among the plurality of sets of image 
10 data having undergone the acceptability evaluation performed 
at the evaluation device. 
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sought on the invertion entitled: IMAGE PROCESSING APPARATUS HAVING IMAGE SELECTION 
FDNCTION, AND RECORDING MEDIUM HAVING IMAGE SELECTION FUNCTION PROGRAM 

described and claimed in the spedlication: 
Check one 

*a. SI attached hereto. 

b. □ filedon as Application No. andamendedon {If applicabte). 

[ hereby state that i have reviewed and understand the contents of the above-identified specification, including 
the claims, as amended by any amendment referred to above. 

I acknowtef^ the duty to disclose to the Oftica all infomration Known to me to be material to patentability as 
defined in Title 37. Code of Federal Regulations, §1 .56. 

Under Title 35. a& Code §119. the priority benefits of thefbflowing foreign application(s) and/or United Slates 

11-00907? filed January 18,1999, 11^009073 filed January 18,1999, 
1 1-009079 filsd January 18,1999, 11-009080 filed janiiary 18,1999 

The follcwing appllcation(s) for patent or inventor^ certificate on tfis invention were filed in countries foreign to 
the United States of Amedca either (a) more than one year prior to this application, or (b) fotibre the filing data of the 
above-named foreign priority application^) andtor United States provisional applicatux^s): 



I heret}y appoint the following as my attorneys of record with ftjit power of substitution artd revocation to 
prosecute this application and to transmit an business in the Patent Office: 

James A, OlHl^ Reg. No. 27,075; wnilam P. Berndge. Reg. Mo. 30,024; 
Kirk M. Hudson, Reg. No. 27fi62; Thomas J. Pardinl. Reg. No. 30^11 ; 
Edward P. Walker, Reg. No. 31^; Robert A. Miller, Registiafion No. 32,771 and 
Mario A. Costantino, Regisiration No. 33,56S. 

ALL CORRESPONDENCE IN CONNECTION WITH TH5 APPUCATION SHOULD BE SENT TO OUFF & 
SERRIDGE. PJ-C PJ_C P.O. BOX 13928, ALEXANDRIA, VIRGINIA 22320, TELEPHONE (703) 836-6400. 

I hereby declare that 1 have reviewed and understand the contents of this Dedaraiion, and that aU statements 
made herein of my own lOKWledge are tnje and lhat all statements made on informatfon artd befief are beSeved to be 
tme; and further that these stMments were made with the knowledge that wlSfu! ^Ise statements and the like so made 
are punishable by fine or impflsorunent. or both, tsider Section 1001 of Title 1 a of tie United States Code arxl that 
such waiful false statements may jeopardize the validity of Sie applicatian or any patent Issued thereon. 

Typmnitten Futt Name 



^'Inventor's Signature: 


Given Name 


Middle Initial 


Family Name 

/t- 


*^ate of Signature: 










Month 


Day 


Year 


Residence: Setacrava 


-ku 


TOKYO 


JAPAN 


Citizenship: Japan 


City 


State or Provinca 


Country 



Post Office Address: 

(Insert complete C/0 Nikon Corporation,Fuj 1 Bldg. ,2-3 ,MaruiiQuchi 

SSjS'S^Sr) 3-chome,Chiyoda-kai, TOKYO 100-8331 JAPAN 

* If Box <a.) is checked, this fdnn may be executed only when attached to the specificaiion CmducBng claims). 
**f*tote to Inventor Please sign name exactly as it appears above and insert actual date of signing. 

IF THERE tS MORE THAN ONE INVENTOR USE PAGE 2 AND PLACE AN 'TC HERE CI 

10/96 



PAGE 2 OF U.S,A. DECLARATION FORM 
(Discard this page in a sole inventor application) 



Typewritten Full Namo 

of Second Joint Inventor (if any) Hirotake 



*~lnventor's Signature: 
"Date of Signature: 



Famify Name 



Residence: 
Citizenship: 



Koutou-ku 



State or Province 



Post Office Address: 
(Insert complete 



C/O Nrikon Corpora t-ion, Pu j i Bldg, , 2-3 ,Marunouchi 



SSfnJ'SiS) 3-chQme,Chiyoda-ku, TOKYO 100-8331 JAPAN 



Typ&mitten Full Name 

of Third Joint Inventor (if any) 



"Inventor's Signatuie: 
**Date of Signature: 



Given Name 



Famiiy Narrte 



Residence: 
Citizenship: 



Month 
Ebina-shi 



Day 
KANAGAWA 



Year / 97^^ 
JAPAN 



State or Province 



(InSrtS^iSe^ C/O Nikon Corporation, Fuji Bldg. ,2-3 ,Mar«noueh i 

malllngaddress 3-chorae ,Chiyoda-ku,TOKYO 100-8331 JAPAN 

including country) ' ' 



Typewrite Full Name 

of Fourth Joint Inventor (if any) 



••Inventor's Signature: 
••Date of Signature: 



Famiiy Name 



Residence: 
Citsenshtp: 



state or Province 



Post Office Address: 
(Insert complete 
mailing address, 
including country) 
Typwrittan Full Name 
of Fifth Joint Inventor (If any) 



"Inventor's Signature: 
••Data of Signature: 



Citizenship: 



State or Province 



Post Office Address: 

(Insert ccmpleie 
malDng sddfess, 
including country) 

*Mote to Inventors: PlMa« «lgn name exactly as It appsan and insMt the actual data of signing. ~ 
Tliblbm may tMsnojtedoiiy whan attadKdta the tM 



